-- Logs begin at Thu 2022-05-26 16:56:54 UTC, end at Thu 2022-05-26 18:31:11 UTC. -- May 26 17:50:20.527745 dv-cinder-839064-2-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 17:50:20.537000 dv-cinder-839064-2-smb devstack@keystone.service[80345]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 17:50:20 2022] *** May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: nodename: dv-cinder-839064-2-smb May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: machine: x86_64 May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: clock source: unix May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: pcre jit disabled May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: detected number of CPU cores: 4 May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: current working directory: / May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: detected binary path: /usr/bin/uwsgi-core May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: your processes number limit is 47680 May 26 17:50:20.539033 dv-cinder-839064-2-smb devstack@keystone.service[80345]: your memory page size is 4096 bytes May 26 17:50:20.539817 dv-cinder-839064-2-smb devstack@keystone.service[80345]: detected max file descriptor number: 2048 May 26 17:50:20.539817 dv-cinder-839064-2-smb devstack@keystone.service[80345]: lock engine: pthread robust mutexes May 26 17:50:20.539817 dv-cinder-839064-2-smb devstack@keystone.service[80345]: thunder lock: enabled May 26 17:50:20.539817 dv-cinder-839064-2-smb devstack@keystone.service[80345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 17:50:20.539817 dv-cinder-839064-2-smb devstack@keystone.service[80345]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 17:50:20.584167 dv-cinder-839064-2-smb devstack@keystone.service[80345]: Python main interpreter initialized at 0x556a4d78e9c0 May 26 17:50:20.584167 dv-cinder-839064-2-smb devstack@keystone.service[80345]: python threads support enabled May 26 17:50:20.584167 dv-cinder-839064-2-smb devstack@keystone.service[80345]: your server socket listen backlog is limited to 100 connections May 26 17:50:20.584167 dv-cinder-839064-2-smb devstack@keystone.service[80345]: your mercy for graceful operations on workers is 90 seconds May 26 17:50:20.584497 dv-cinder-839064-2-smb devstack@keystone.service[80345]: mapped 403077 bytes (393 KB) for 2 cores May 26 17:50:20.584560 dv-cinder-839064-2-smb devstack@keystone.service[80345]: *** Operational MODE: preforking *** May 26 17:50:20.584829 dv-cinder-839064-2-smb devstack@keystone.service[80345]: *** uWSGI is running in multiple interpreter mode *** May 26 17:50:20.584829 dv-cinder-839064-2-smb devstack@keystone.service[80345]: spawned uWSGI master process (pid: 80345) May 26 17:50:20.585024 dv-cinder-839064-2-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 17:50:20.586031 dv-cinder-839064-2-smb devstack@keystone.service[80345]: spawned uWSGI worker 1 (pid: 80357, cores: 1) May 26 17:50:20.586031 dv-cinder-839064-2-smb devstack@keystone.service[80345]: spawned uWSGI worker 2 (pid: 80358, cores: 1) May 26 17:50:20.586180 dv-cinder-839064-2-smb devstack@keystone.service[80345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 17:50:26.344595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:50:26.344595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: from cryptography.utils import int_from_bytes May 26 17:50:26.345308 dv-cinder-839064-2-smb devstack@keystone.service[80358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:50:26.345308 dv-cinder-839064-2-smb devstack@keystone.service[80358]: from cryptography.utils import int_from_bytes May 26 17:50:26.345495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:50:26.345495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: from cryptography.utils import int_from_bytes May 26 17:50:26.345951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:50:26.345951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: from cryptography.utils import int_from_bytes May 26 17:50:26.395148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:50:26.395342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:50:26.395505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] command line args: [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:50:26.395806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:50:26.396014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ================================================================================ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:50:26.396098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:50:26.396219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:50:26.396327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] admin_token = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.396439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] command line args: [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:50:26.396562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] config_dir = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.396713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:50:26.396790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.396893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ================================================================================ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:50:26.396981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] config_source = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.397149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] admin_token = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.397236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] debug = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.397381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.397676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] config_dir = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.397676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.397878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.397980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] config_source = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] debug = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.398912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_config_append = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_dir = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399607 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_config_append = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_dir = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.399970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_file = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.400934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.401891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.402037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.402116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.402272 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.402362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.402512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.402637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.402766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.123/identity {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] publish_errors = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.123/identity {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.403944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] publish_errors = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.404081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.404161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.404327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.404406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.404610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.404692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] standard_threads = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.404770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.404839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] standard_threads = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_journal = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_json = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_stderr = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_syslog = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.405915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.406032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_journal = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.406108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.406210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_json = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.406293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.406369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_stderr = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.406527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.406603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_syslog = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.406766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:50:26.406840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407249 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.407962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.408036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.408199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.408272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.408468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.408555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.408707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.408787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.408939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409019 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.409979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.410129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.410204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.410918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.411089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.411174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.411353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.411429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.411597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.411679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.411857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.411939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.412111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.412185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.412382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.412460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.412630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.412720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.412887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.412962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.413125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.413197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.413356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.413438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.413590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.413665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.413835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.413910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.414064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.414146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.414294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.414372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.414523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.414603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.414767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.414877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.415958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.416981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.417143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.417213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.417374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.417437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.417608 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.417685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.417839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.417911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.418069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.418144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.418296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.418375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.418532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.418614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.418768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.418844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.419975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.420959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.421119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.421206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.421353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.421427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.421583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.421664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.421835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.421922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.422070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.422145 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.422301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.422376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.422538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.422620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.422770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.422847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.423970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.424053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.424205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.424297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.424468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.424555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.424713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.424789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.424950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.425035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.425186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.425261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.425422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.425494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.425654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.425740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.425917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.426916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.427080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.427167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.427315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.427395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.427548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.427623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.427785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.427867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428607 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.428971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.429984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.430127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.430210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.430362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.430444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.430594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.430677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.430834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.430909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.431080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.431161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.431329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.431412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.431566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.431641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.external = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.431791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.431867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.432067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.432154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.432341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.432420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.432550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.password = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.432660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.external = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.432778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.token = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.432856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.password = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.token = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.433965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.434970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.435136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.435212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.435368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.435445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.435599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.435673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.435841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.435918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.436075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.436151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.436348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.436426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.436591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.436670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.436834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.436916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.437069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.437145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.437331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.437409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.437585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.437661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.437824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.437901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.438072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.438148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.438402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.438561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.438637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.438794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.438872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.439037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.439113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.439298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.439374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.439534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.439610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.439771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.439847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.440999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.441076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.441240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.441314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.441562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.441695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.441843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.441985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.442107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.442184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.442284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.442368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.442528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.442606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.442775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.442883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.443023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.443113 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.443262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.443438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.443514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.443729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.443804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.443960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.444117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.444200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.444471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.444552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.444806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.444982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.445149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.445393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.445513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.445694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.445876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.445966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.446170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.446247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.446421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.446619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.446696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.446918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.447001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.447167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.447332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.447443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.447667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.447762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.447914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.448026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.448149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.448400 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.448479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.448649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.448763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.448888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.449117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.449194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.449355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.449470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.449604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.449715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.449838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.449959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.450089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.450211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.450335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.450444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.450572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.450692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.450820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.450939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.451067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.451176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.451298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.451421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.451535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.451666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.451764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.451895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452002 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.452986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.453100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.453236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.453336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.453483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.453560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.453716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.453801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.453957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.454033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.454206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.454282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.454453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.454538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.454692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.454768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.454928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.455004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.455165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.455250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.455396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.455559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.455635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.455880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.455956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.456111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.456189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.456379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.456570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.456647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.456861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.457530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.457672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.457909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.457984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.458243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.458479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.458570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.458717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.458948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.459031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.459196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.459443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.459525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.459690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.459813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.459936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.460170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.460344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.460436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.460567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.460646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.460882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.460958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.461124 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.461204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.461360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.461435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.461597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.461673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.461850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.461975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.462096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.462174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.462333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.462409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.462576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.462652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.462805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.462881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.463987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.464116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.464231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.464382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.464502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.464610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.464740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.464851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.464994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.465097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.465226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.465351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.465471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.465598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.465706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.465840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.465942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.466091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.466175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.466344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.466420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.466583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.466659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.466831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.466916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.467071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.467148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.467313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.467457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.467533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] role.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.467785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] role.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.467940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.468017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.468253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.468371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.468526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.468686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.468765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.469011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.469087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.469259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.469437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.469524 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.469740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.469816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.469987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.470140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.470217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.470457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.470534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.470703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.470779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.470950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.471130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] role.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.471208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.471501 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] role.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.471598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.471836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.471911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.472086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.472250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.472387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.472552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.472630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.473386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.473488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.473652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.473788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.474980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.475127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.475205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.475379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.475455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.475634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.475720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.475881 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.475957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.476126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.476292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.476429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.476542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.476622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.476790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.476873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.477040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.477117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.477289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.477369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.477528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.477604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.477775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.477849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.478027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.478106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.478264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.478339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.478510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.478594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.478758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.478835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.479005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.479145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.479242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.479467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.479546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.479704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.479815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.479950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.480199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.480286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.480450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.480609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.480687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.480975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.481052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.481233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.481347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.481479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.481669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.481747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.481958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.482035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.482204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.482295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.482443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.482659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.482737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.482902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.483023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.483141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.483394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.483470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.483633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.483782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.483859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.484073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.484152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.484339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.484419 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.484581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.484694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.484827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.484908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.485060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.485138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.485304 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.485381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.485540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.485617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.485707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:50:26.485784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.486018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.486246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.486491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.486783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.487042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.487286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.487532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.487768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.488009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.488246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.488649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.488871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.489110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.489356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.489592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.489834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.490071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.490318 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.490554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.490796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.491028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.491271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.491506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:50:26.491675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:50:26.516672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.516913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.517128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.518011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.518245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.518477 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.526438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.527812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.555437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.555604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.556256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.556515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.609268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.609429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.661840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.662084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.662201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.662317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.729910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.730044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.730125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.730256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.753767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.754449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.754598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.754697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.754909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.755042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.755169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.755294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.755475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.755634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.755760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.755882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.756005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.756127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.767248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.768053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.780677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.780905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.781124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.781341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.781556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.781768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.781981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.782864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.783147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.783283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.783483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.783701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.783915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.784204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 17:50:26.801996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.802240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 17:50:26.802526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.802730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 17:50:26.802855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.802998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 17:50:26.803144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.803273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.803500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.803500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 17:50:26.803739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.803876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.804004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.804129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.804254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.804449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.814904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.815137 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.815409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.815691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.815816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.816034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.816296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.817222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.824465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.825681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.827852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.828132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.828441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.828725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.828993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.829119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.829268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.829402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.829530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.829657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.829810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.829934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.830079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.830206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.830332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.830457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.830583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.830710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.830944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.831209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.831478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.831740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.859158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.860933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.861207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.864605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.866521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.866753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.866905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.867045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.867179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.873900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.874178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.874393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.874619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.874754 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.880022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.880450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.880729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.881008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.881279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.881547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.881808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.882069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.882662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.882947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.887478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.887874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.888156 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.888475 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.888756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.889034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.889305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.889575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.902463 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.902733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.907430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.908871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.909148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.911242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.911532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.914016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.916789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.917719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.918017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.920403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.923110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.924148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.924545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.924831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.925111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.925390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.925660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.926760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.930580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.930882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.931164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.931453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.931730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.932014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.945357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.945634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.945893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.946158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.951793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.952079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.952385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.952639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.954172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.955871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.956144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.959771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.960044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.960343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.960617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.960889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.961504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.963219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.963497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.966588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.966875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.967155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.967433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.967706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.974444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.994738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.994738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.994738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.994738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.994738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.994738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.995108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.995108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.995108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.995108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.995108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.995108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.995405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:26.995466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:26.998090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.001301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.001452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.003330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.005414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.005584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.005869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.006147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.008765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.010374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.012004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.012290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.012601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.013607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.015207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.018542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.018828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.019108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.019380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.020759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.022373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.025677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.025968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.026248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.026519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.029051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.029334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.029713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.035838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.036125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.036527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.037743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.038019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.038298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.038571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.038838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.039105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.039390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.039656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.039931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.040203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.040499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.040757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.041032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.041296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.044488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 17:50:27.044772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.045054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.045330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.045600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.045869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.046155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.046421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.046694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.046968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.047237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.047497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.047767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.048033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 17:50:27.081137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556a4d78e9c0 pid: 80358 (default app) May 26 17:50:27.085076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001232-8a72-4a43-b2e4-cd472d575a67 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:27.085365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001232-8a72-4a43-b2e4-cd472d575a67 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:27.085685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001232-8a72-4a43-b2e4-cd472d575a67 None None] PATH_INFO: `/v3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:27.088170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556a4d78e9c0 pid: 80357 (default app) May 26 17:50:27.089921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1/1] 10.222.0.123 () {50 vars in 796 bytes} [Thu May 26 17:50:27 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:36.737698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09d7fc-335f-4f03-9b38-080649bb2109 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:36.738189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09d7fc-335f-4f03-9b38-080649bb2109 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:36.738277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09d7fc-335f-4f03-9b38-080649bb2109 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:36.743370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1/2] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:36 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:36.748489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:36.748873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:36.749033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:36.819692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: INFO dbcounter [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] Registered counter for database keystone May 26 17:50:36.844563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG oslo_db.sqlalchemy.engines [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:50:36.851545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writer thread running {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:50:37.027371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG passlib.handlers.bcrypt [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80358) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 17:50:37.027714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG passlib.handlers.bcrypt [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80358) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 17:50:37.083834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:37.085591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:37.209419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 2/3] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:36 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 17:50:37.382546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09d7fc-335f-4f03-9b38-080649bb2109 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:37.452574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: INFO dbcounter [None req-de09d7fc-335f-4f03-9b38-080649bb2109 None None] Registered counter for database keystone May 26 17:50:37.471731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG oslo_db.sqlalchemy.engines [None req-de09d7fc-335f-4f03-9b38-080649bb2109 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:50:37.478500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writer thread running {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:50:37.599415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09d7fc-335f-4f03-9b38-080649bb2109 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:37.603624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84606ea1-92bd-4bff-b5e5-ee33473b5052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:37.604276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606ea1-92bd-4bff-b5e5-ee33473b5052 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:37.604588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606ea1-92bd-4bff-b5e5-ee33473b5052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:37.604864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606ea1-92bd-4bff-b5e5-ee33473b5052 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:37.612975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84606ea1-92bd-4bff-b5e5-ee33473b5052 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:37.665101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING keystone.common.rbac_enforcer.enforcer [None req-84606ea1-92bd-4bff-b5e5-ee33473b5052 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 17:50:37.665437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84606ea1-92bd-4bff-b5e5-ee33473b5052 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:37.675119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 2/4] 10.222.0.123 () {58 vars in 1329 bytes} [Thu May 26 17:50:37 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 17:50:37.681525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:37.695931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280517b-6b47-4db0-b9f4-11a61eba7e08 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:37.700242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794b309-bd0a-4c1e-86d5-aca63a25ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:37.701457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b309-bd0a-4c1e-86d5-aca63a25ea64 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:37.701742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b309-bd0a-4c1e-86d5-aca63a25ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:37.702012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b309-bd0a-4c1e-86d5-aca63a25ea64 admin admin] PATH_INFO: `/v3/projects/c5b85a0a8c034126972b9b0b0e372a47` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:37.703507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794b309-bd0a-4c1e-86d5-aca63a25ea64 admin admin] RBAC: Authorizing `identity:get_project(project_id=c5b85a0a8c034126972b9b0b0e372a47)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:37.864501 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1794b309-bd0a-4c1e-86d5-aca63a25ea64 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 17:50:37.865100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794b309-bd0a-4c1e-86d5-aca63a25ea64 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:37.869392 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 3/5] 10.222.0.123 () {56 vars in 1212 bytes} [Thu May 26 17:50:37 2022] GET /identity/v3/projects/c5b85a0a8c034126972b9b0b0e372a47 => generated 345 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:40.038409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33064-8763-47fc-a560-def2c120519a None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:40.039006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33064-8763-47fc-a560-def2c120519a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:40.039006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33064-8763-47fc-a560-def2c120519a None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:40.043146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 3/6] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:40 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:40.048573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fa09e-f4f2-4fdb-8491-f72ab4306f1d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:40.048937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fa09e-f4f2-4fdb-8491-f72ab4306f1d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:40.049128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fa09e-f4f2-4fdb-8491-f72ab4306f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:40.069433 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-606fa09e-f4f2-4fdb-8491-f72ab4306f1d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:40.070941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-606fa09e-f4f2-4fdb-8491-f72ab4306f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:40.078743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 4/7] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:40 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 17:50:40.101626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33064-8763-47fc-a560-def2c120519a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:40.114519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33064-8763-47fc-a560-def2c120519a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:40.118656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183cc84-1c9d-493f-a8ef-412406929b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:40.119278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183cc84-1c9d-493f-a8ef-412406929b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:40.119557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183cc84-1c9d-493f-a8ef-412406929b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:40.119830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183cc84-1c9d-493f-a8ef-412406929b41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:40.127768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183cc84-1c9d-493f-a8ef-412406929b41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:40.130308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183cc84-1c9d-493f-a8ef-412406929b41 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:40.138968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 4/8] 10.222.0.123 () {58 vars in 1329 bytes} [Thu May 26 17:50:40 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 17:50:40.144827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fa09e-f4f2-4fdb-8491-f72ab4306f1d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:40.153733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fa09e-f4f2-4fdb-8491-f72ab4306f1d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:40.158025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc53fa-52aa-4a88-ad99-e6f6f5910ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:40.158867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc53fa-52aa-4a88-ad99-e6f6f5910ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:40.159144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc53fa-52aa-4a88-ad99-e6f6f5910ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:40.159413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc53fa-52aa-4a88-ad99-e6f6f5910ed3 admin admin] PATH_INFO: `/v3/users/a9572da5208c472b8724a85b89731b10` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:40.160827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc53fa-52aa-4a88-ad99-e6f6f5910ed3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a9572da5208c472b8724a85b89731b10)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:40.162649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc53fa-52aa-4a88-ad99-e6f6f5910ed3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:40.164193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 5/9] 10.222.0.123 () {56 vars in 1203 bytes} [Thu May 26 17:50:40 2022] GET /identity/v3/users/a9572da5208c472b8724a85b89731b10 => generated 248 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:42.459285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb99740-4bca-4b08-b785-1c786f0fa1d0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:42.459792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb99740-4bca-4b08-b785-1c786f0fa1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:42.459874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb99740-4bca-4b08-b785-1c786f0fa1d0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:42.461196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 5/10] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:42.466438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086bda9-f2a9-46e9-9d63-eecafaafa5c9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:42.466844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086bda9-f2a9-46e9-9d63-eecafaafa5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:42.467005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086bda9-f2a9-46e9-9d63-eecafaafa5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:42.473186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7614a-e9bc-45d1-8b15-08a0fd082eb9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:42.473467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7614a-e9bc-45d1-8b15-08a0fd082eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:42.473741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7614a-e9bc-45d1-8b15-08a0fd082eb9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:42.475024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 6/11] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:50:42.481179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:42.481461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:42.481735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:42.484789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6086bda9-f2a9-46e9-9d63-eecafaafa5c9 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:42.485965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6086bda9-f2a9-46e9-9d63-eecafaafa5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:42.523433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG passlib.handlers.bcrypt [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80357) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 17:50:42.523874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG passlib.handlers.bcrypt [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80357) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 17:50:42.568737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 6/12] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:42.570942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:42.572589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:42.591941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086bda9-f2a9-46e9-9d63-eecafaafa5c9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:42.616122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:42.676894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 7/13] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:50:42.699739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086bda9-f2a9-46e9-9d63-eecafaafa5c9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:42.700396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:42.738492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eb242-7532-4cd4-89e0-69d3b6295777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:42.739706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb242-7532-4cd4-89e0-69d3b6295777 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:42.739989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb242-7532-4cd4-89e0-69d3b6295777 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:42.740268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb242-7532-4cd4-89e0-69d3b6295777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:42.814294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eb242-7532-4cd4-89e0-69d3b6295777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:42.815800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eb242-7532-4cd4-89e0-69d3b6295777 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:42.841656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:42.912734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f6b46-07a9-4b84-8d85-e36d1398adc7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:42.915715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:42.918000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 7/14] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:50:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:50:42.923569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eb242-7532-4cd4-89e0-69d3b6295777 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:42.952379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dccda-73bb-45fb-9f14-7a38b2d26126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:42.953435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dccda-73bb-45fb-9f14-7a38b2d26126 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:42.953713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dccda-73bb-45fb-9f14-7a38b2d26126 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:42.953990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dccda-73bb-45fb-9f14-7a38b2d26126 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:42.970973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dccda-73bb-45fb-9f14-7a38b2d26126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-8a1dccda-73bb-45fb-9f14-7a38b2d26126 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:42.983329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:42.984207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:50:42.985007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 8/15] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:50:42.990834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dccda-73bb-45fb-9f14-7a38b2d26126 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:43.045256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eb242-7532-4cd4-89e0-69d3b6295777 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:43.067964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:43.078738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:43.079515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.084555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.084555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.090223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:43.091745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:43.094085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dccda-73bb-45fb-9f14-7a38b2d26126 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:43.112397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:43.113821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:43.114929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:43.114929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:43.114929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:43.114929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:50:43.114929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 8/16] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:50:43.120173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:43.130773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:43.131440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.131723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.132004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.132786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:43.133097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:43.134554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:43.147016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 9/17] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:50:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:43.152322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:43.179737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:43.220571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953932-abbb-4178-9a2b-51df38449201 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:43.252284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cd98e-1bdb-404f-812c-2d7219bf1a26 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:43.255450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:43.256099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.256405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.256679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.257401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:43.257704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:43.259088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:43.276179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 9/18] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:50:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:43.296210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ce4d2-8b21-45c4-bb38-d6f797267ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:43.297166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce4d2-8b21-45c4-bb38-d6f797267ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.297453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce4d2-8b21-45c4-bb38-d6f797267ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.297733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ce4d2-8b21-45c4-bb38-d6f797267ea2 None admin] PATH_INFO: `/v3/users/a9572da5208c472b8724a85b89731b10` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.299488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ce4d2-8b21-45c4-bb38-d6f797267ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=a9572da5208c472b8724a85b89731b10)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:43.301840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ce4d2-8b21-45c4-bb38-d6f797267ea2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:43.303695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 10/19] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:50:43 2022] GET /identity/v3/users/a9572da5208c472b8724a85b89731b10 => generated 248 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:43.309505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:43.350274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:43.424905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eccdbf-66a8-4a21-8b75-b66b96150586 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:43.461393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6a48d-ad30-419a-b1ea-9a1a4d85e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:43.462229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6a48d-ad30-419a-b1ea-9a1a4d85e97b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.462508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6a48d-ad30-419a-b1ea-9a1a4d85e97b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.462782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6a48d-ad30-419a-b1ea-9a1a4d85e97b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.463973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6a48d-ad30-419a-b1ea-9a1a4d85e97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:43.465676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6a48d-ad30-419a-b1ea-9a1a4d85e97b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:43.467431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 10/20] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:43 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:43.474301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ce4d2-8b21-45c4-bb38-d6f797267ea2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:43.574846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:43.581117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ce4d2-8b21-45c4-bb38-d6f797267ea2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:43.618856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed4260-bdf4-4db4-b147-86f1e7f5fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:43.619447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4260-bdf4-4db4-b147-86f1e7f5fb7f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:43.619728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4260-bdf4-4db4-b147-86f1e7f5fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:43.620000 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4260-bdf4-4db4-b147-86f1e7f5fb7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:43.620875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed4260-bdf4-4db4-b147-86f1e7f5fb7f None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.domain.id=default, user.id=a9572da5208c472b8724a85b89731b10) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:43.621191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed4260-bdf4-4db4-b147-86f1e7f5fb7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:43.622636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed4260-bdf4-4db4-b147-86f1e7f5fb7f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:43.632104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 11/21] 10.222.0.123 () {56 vars in 1327 bytes} [Thu May 26 17:50:43 2022] GET /identity/v3/role_assignments?user.id=a9572da5208c472b8724a85b89731b10&scope.domain.id=default&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 234 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:46.284944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f719-c0eb-4e74-9932-fd0da43da3d3 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.285942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f719-c0eb-4e74-9932-fd0da43da3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.286443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f719-c0eb-4e74-9932-fd0da43da3d3 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.288365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 11/22] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:46.293710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053015-a964-4fd2-8991-71ffe8f5a609 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.299269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053015-a964-4fd2-8991-71ffe8f5a609 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.299746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053015-a964-4fd2-8991-71ffe8f5a609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.326011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c9053015-a964-4fd2-8991-71ffe8f5a609 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:46.327563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c9053015-a964-4fd2-8991-71ffe8f5a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:46.414418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 12/23] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:46.449115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5f719-c0eb-4e74-9932-fd0da43da3d3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:46.601176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5f719-c0eb-4e74-9932-fd0da43da3d3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:46.603089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:46.620162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b0fc9-8f06-4039-80f8-90429c30e908 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.620821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b0fc9-8f06-4039-80f8-90429c30e908 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.621299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b0fc9-8f06-4039-80f8-90429c30e908 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.628149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 13/24] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:46 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:46.634301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc84bb-9381-47a9-89cb-c5e625442079 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.634885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc84bb-9381-47a9-89cb-c5e625442079 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.635364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc84bb-9381-47a9-89cb-c5e625442079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.647890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38b68e-7803-4acb-b990-a4c8f1791b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:46.648594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38b68e-7803-4acb-b990-a4c8f1791b27 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.648873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38b68e-7803-4acb-b990-a4c8f1791b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.649143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38b68e-7803-4acb-b990-a4c8f1791b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.651028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38b68e-7803-4acb-b990-a4c8f1791b27 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:46.652444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38b68e-7803-4acb-b990-a4c8f1791b27 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:46.671696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d0fc84bb-9381-47a9-89cb-c5e625442079 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:46.673334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d0fc84bb-9381-47a9-89cb-c5e625442079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:46.766338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 14/25] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:50:46.767806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7194f4-741c-4629-ae44-3ff136c8b190 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.768100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7194f4-741c-4629-ae44-3ff136c8b190 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.768467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7194f4-741c-4629-ae44-3ff136c8b190 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.769873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 15/26] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:46.775242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0e7f-5bfa-4a0f-b31e-732ceb8483b1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:46.775535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0e7f-5bfa-4a0f-b31e-732ceb8483b1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:46.775819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0e7f-5bfa-4a0f-b31e-732ceb8483b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:46.793232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d14a0e7f-5bfa-4a0f-b31e-732ceb8483b1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:46.794446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d14a0e7f-5bfa-4a0f-b31e-732ceb8483b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:46.810907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:46.910386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 16/27] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:50:46.911492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a0e7f-5bfa-4a0f-b31e-732ceb8483b1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:46.978003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 12/28] 10.222.0.123 () {60 vars in 1136 bytes} [Thu May 26 17:50:46 2022] POST /identity/v3/roles => generated 220 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:50:46.979048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38b68e-7803-4acb-b990-a4c8f1791b27 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:47.135056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a0e7f-5bfa-4a0f-b31e-732ceb8483b1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:47.141012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38b68e-7803-4acb-b990-a4c8f1791b27 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:47.185090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcd652-40e6-4c1e-bc88-ed363786a6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:47.185828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcd652-40e6-4c1e-bc88-ed363786a6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.186108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcd652-40e6-4c1e-bc88-ed363786a6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.186378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcd652-40e6-4c1e-bc88-ed363786a6e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.188126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9730ec-de21-45cc-9df6-a3a7061c2e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:47.188944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9730ec-de21-45cc-9df6-a3a7061c2e83 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.189223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9730ec-de21-45cc-9df6-a3a7061c2e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.189496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9730ec-de21-45cc-9df6-a3a7061c2e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.201514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcd652-40e6-4c1e-bc88-ed363786a6e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:47.203195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9730ec-de21-45cc-9df6-a3a7061c2e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:47.205090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9730ec-de21-45cc-9df6-a3a7061c2e83 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0dbcd652-40e6-4c1e-bc88-ed363786a6e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:47.210576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:47.211428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:50:47.212155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 17/29] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:47.221018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da8b48-191b-4453-88c0-7268a6f3f61f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.221018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da8b48-191b-4453-88c0-7268a6f3f61f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.221018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da8b48-191b-4453-88c0-7268a6f3f61f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.221018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 18/30] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:47.221018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30e4b9-fbe4-44f4-a3ab-374f76ba628f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.221018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30e4b9-fbe4-44f4-a3ab-374f76ba628f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.221354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30e4b9-fbe4-44f4-a3ab-374f76ba628f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.221354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 19/31] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:47 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:47.224218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30e4b9-fbe4-44f4-a3ab-374f76ba628f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-af9730ec-de21-45cc-9df6-a3a7061c2e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:50:47.226434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:47.227555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:47.228388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:50:47.228388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:50:47.228388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:50:47.228388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:50:47.228388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 13/32] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:47.230802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1a4c-c88e-48fd-80b8-f9effd71136b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.231089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1a4c-c88e-48fd-80b8-f9effd71136b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.231413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1a4c-c88e-48fd-80b8-f9effd71136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.242835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:47.252995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3f6b1a4c-c88e-48fd-80b8-f9effd71136b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:47.255315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3f6b1a4c-c88e-48fd-80b8-f9effd71136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:47.266144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:47.342739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 14/33] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:47.344015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510b48-6472-4a24-913a-a87de6af8489 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.344436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510b48-6472-4a24-913a-a87de6af8489 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.344816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510b48-6472-4a24-913a-a87de6af8489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.368772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0e510b48-6472-4a24-913a-a87de6af8489 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:47.369152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30e4b9-fbe4-44f4-a3ab-374f76ba628f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:47.369964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0e510b48-6472-4a24-913a-a87de6af8489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:47.406712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:47.407395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.407680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.407954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.408749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:47.409058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:47.410499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:47.420694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 20/34] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:50:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:47.426349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:47.449143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 15/35] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:47.450208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e510b48-6472-4a24-913a-a87de6af8489 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:47.510830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:47.533616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:47.543517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940c5b-5944-4a22-8f34-06031745006c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:47.559424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e510b48-6472-4a24-913a-a87de6af8489 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:47.582680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:47.583351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.583632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.583905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.584660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:47.584966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:47.586349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:47.598786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e99782-f866-4fc0-9cbe-226bf59e5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:47.599711 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99782-f866-4fc0-9cbe-226bf59e5f4a None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.599990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99782-f866-4fc0-9cbe-226bf59e5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.600264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99782-f866-4fc0-9cbe-226bf59e5f4a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.601029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e99782-f866-4fc0-9cbe-226bf59e5f4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:47.602415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e99782-f866-4fc0-9cbe-226bf59e5f4a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:47.607773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 21/36] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:50:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:47.608636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:47.695817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 16/37] 10.222.0.123 () {60 vars in 1136 bytes} [Thu May 26 17:50:47 2022] POST /identity/v3/roles => generated 226 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:50:47.695817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e99782-f866-4fc0-9cbe-226bf59e5f4a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:47.722937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104ba1-45bb-44ef-bb6c-d98cfd9c6a25 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:47.750053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:47.757496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac637c-d75b-4139-a696-037dcef12808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:47.758634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac637c-d75b-4139-a696-037dcef12808 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.759044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac637c-d75b-4139-a696-037dcef12808 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.759462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac637c-d75b-4139-a696-037dcef12808 None admin] PATH_INFO: `/v3/users/a9572da5208c472b8724a85b89731b10` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.760795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac637c-d75b-4139-a696-037dcef12808 None admin] RBAC: Authorizing `identity:get_user(user_id=a9572da5208c472b8724a85b89731b10)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:47.762352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac637c-d75b-4139-a696-037dcef12808 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:47.764087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 22/38] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:50:47 2022] GET /identity/v3/users/a9572da5208c472b8724a85b89731b10 => generated 248 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:47.764939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac637c-d75b-4139-a696-037dcef12808 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:47.851616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e99782-f866-4fc0-9cbe-226bf59e5f4a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:47.890750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac637c-d75b-4139-a696-037dcef12808 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:47.893162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44c8fa-a698-4b14-a52d-e0a5fd90164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:47.894171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c8fa-a698-4b14-a52d-e0a5fd90164e None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.895282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c8fa-a698-4b14-a52d-e0a5fd90164e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.895749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c8fa-a698-4b14-a52d-e0a5fd90164e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.896746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44c8fa-a698-4b14-a52d-e0a5fd90164e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:47.898364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44c8fa-a698-4b14-a52d-e0a5fd90164e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:47.902571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:47.934521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5771bf-0f9b-4e91-954b-6d1d7d73a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:47.935196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5771bf-0f9b-4e91-954b-6d1d7d73a444 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:47.935481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5771bf-0f9b-4e91-954b-6d1d7d73a444 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:47.935757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5771bf-0f9b-4e91-954b-6d1d7d73a444 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:47.936518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5771bf-0f9b-4e91-954b-6d1d7d73a444 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:47.938010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5771bf-0f9b-4e91-954b-6d1d7d73a444 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:48.037156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 17/39] 10.222.0.123 () {60 vars in 1136 bytes} [Thu May 26 17:50:47 2022] POST /identity/v3/roles => generated 224 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:50:48.042101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44c8fa-a698-4b14-a52d-e0a5fd90164e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:48.153693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44c8fa-a698-4b14-a52d-e0a5fd90164e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:48.191823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a3922-13bc-4bc3-8474-594febfec920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:48.192667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3922-13bc-4bc3-8474-594febfec920 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:48.193012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3922-13bc-4bc3-8474-594febfec920 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:48.193289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3922-13bc-4bc3-8474-594febfec920 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:48.194519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a3922-13bc-4bc3-8474-594febfec920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:48.195994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a3922-13bc-4bc3-8474-594febfec920 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:48.197924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 18/40] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:48.204367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8525c26-07f9-4c23-b019-c301519938d0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:48.204367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8525c26-07f9-4c23-b019-c301519938d0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:48.204367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8525c26-07f9-4c23-b019-c301519938d0 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:48.204367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 19/41] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:48.206077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8525c26-07f9-4c23-b019-c301519938d0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:48.261723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 23/42] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:50:47 2022] POST /identity/v3/projects => generated 302 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:50:48.263214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8f20-80fc-4a47-b007-565694162d05 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:48.263508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8f20-80fc-4a47-b007-565694162d05 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:48.263786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8f20-80fc-4a47-b007-565694162d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:48.283192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0cfd8f20-80fc-4a47-b007-565694162d05 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:48.285693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0cfd8f20-80fc-4a47-b007-565694162d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:48.300980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:48.349560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:48.352164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8525c26-07f9-4c23-b019-c301519938d0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:48.373104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 24/43] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:48.390791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830178f-528f-471f-87fd-a94e08bddd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:48.391685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830178f-528f-471f-87fd-a94e08bddd3a None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:48.391969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830178f-528f-471f-87fd-a94e08bddd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:48.392296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830178f-528f-471f-87fd-a94e08bddd3a None admin] PATH_INFO: `/v3/domains/default/users/a9572da5208c472b8724a85b89731b10/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:48.394529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830178f-528f-471f-87fd-a94e08bddd3a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a9572da5208c472b8724a85b89731b10, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:48.396280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830178f-528f-471f-87fd-a94e08bddd3a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:48.397499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd8f20-80fc-4a47-b007-565694162d05 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:48.501267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd8f20-80fc-4a47-b007-565694162d05 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:48.519262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 20/44] 10.222.0.123 () {58 vars in 1366 bytes} [Thu May 26 17:50:48 2022] PUT /identity/v3/domains/default/users/a9572da5208c472b8724a85b89731b10/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:50:48.538875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a131997-9a1e-4f86-9ba5-1e2079ddb3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:48.539857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131997-9a1e-4f86-9ba5-1e2079ddb3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:48.541089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131997-9a1e-4f86-9ba5-1e2079ddb3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:48.541370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131997-9a1e-4f86-9ba5-1e2079ddb3a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:48.542689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a131997-9a1e-4f86-9ba5-1e2079ddb3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:48.544421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a131997-9a1e-4f86-9ba5-1e2079ddb3a5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:48.546165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 25/45] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:48.552961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830178f-528f-471f-87fd-a94e08bddd3a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:48.660901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830178f-528f-471f-87fd-a94e08bddd3a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:48.684886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:48.699637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a29694-210d-4bf8-b42d-7d2fcebff9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:48.700329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29694-210d-4bf8-b42d-7d2fcebff9c9 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:48.700621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29694-210d-4bf8-b42d-7d2fcebff9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:48.700901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29694-210d-4bf8-b42d-7d2fcebff9c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:48.701622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a29694-210d-4bf8-b42d-7d2fcebff9c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:48.703090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a29694-210d-4bf8-b42d-7d2fcebff9c9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:48.819241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 21/46] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:50:48 2022] POST /identity/v3/projects => generated 313 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:50:50.701426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d6b5-23cb-4dcc-9605-c2d0eb6c7d52 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:50.701957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d6b5-23cb-4dcc-9605-c2d0eb6c7d52 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:50.701957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d6b5-23cb-4dcc-9605-c2d0eb6c7d52 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:50.703282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 26/47] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:50.708927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee47c-8b58-48eb-aff3-ce7faa2daa30 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:50.709346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee47c-8b58-48eb-aff3-ce7faa2daa30 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:50.709493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee47c-8b58-48eb-aff3-ce7faa2daa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:50.726402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-47aee47c-8b58-48eb-aff3-ce7faa2daa30 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:50.727592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-47aee47c-8b58-48eb-aff3-ce7faa2daa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:50.797924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 22/48] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:50.821245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490d6b5-23cb-4dcc-9605-c2d0eb6c7d52 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:50.874827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:50.929356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490d6b5-23cb-4dcc-9605-c2d0eb6c7d52 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:50.962487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e893f-8327-4ee7-b359-28a6cd1aeee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:50.963211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e893f-8327-4ee7-b359-28a6cd1aeee8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:50.963496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e893f-8327-4ee7-b359-28a6cd1aeee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:50.963775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e893f-8327-4ee7-b359-28a6cd1aeee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:50.974343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e893f-8327-4ee7-b359-28a6cd1aeee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-949e893f-8327-4ee7-b359-28a6cd1aeee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:50.982010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:50.983029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:50:50.983797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 27/49] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:50:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:50.989712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aee47c-8b58-48eb-aff3-ce7faa2daa30 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.047581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297fa9-cf66-4590-921f-8dd3cddee903 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.047871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297fa9-cf66-4590-921f-8dd3cddee903 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.048151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da297fa9-cf66-4590-921f-8dd3cddee903 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.049561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 28/50] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:50:51.055190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e883c-9dc7-4057-9ba0-de1b232dc180 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.055574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e883c-9dc7-4057-9ba0-de1b232dc180 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.055930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e883c-9dc7-4057-9ba0-de1b232dc180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.072893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ab4e883c-9dc7-4057-9ba0-de1b232dc180 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:51.074192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ab4e883c-9dc7-4057-9ba0-de1b232dc180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:51.095751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aee47c-8b58-48eb-aff3-ce7faa2daa30 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.098825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:51.130278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.130935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.131223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.131500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.132242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:51.132578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.133958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.145939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 29/52] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:50:51.146094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 23/52] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:50:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:51.151530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e883c-9dc7-4057-9ba0-de1b232dc180 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.169928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.191849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:51.252918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e883c-9dc7-4057-9ba0-de1b232dc180 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.272063 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5f77-0905-480a-8490-86249e71b8eb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.291871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a03aa-280f-48d6-9826-11df5c4fe4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.292781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a03aa-280f-48d6-9826-11df5c4fe4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.293071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a03aa-280f-48d6-9826-11df5c4fe4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.293347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a03aa-280f-48d6-9826-11df5c4fe4d1 None admin] PATH_INFO: `/v3/users/a9572da5208c472b8724a85b89731b10` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.294556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a03aa-280f-48d6-9826-11df5c4fe4d1 None admin] RBAC: Authorizing `identity:get_user(user_id=a9572da5208c472b8724a85b89731b10)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.296012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a03aa-280f-48d6-9826-11df5c4fe4d1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.297682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 30/53] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/users/a9572da5208c472b8724a85b89731b10 => generated 248 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:51.303151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a03aa-280f-48d6-9826-11df5c4fe4d1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.310753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a512fe-70d6-4fbf-b1fc-ba503ff3c9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.311547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a512fe-70d6-4fbf-b1fc-ba503ff3c9bf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.311835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a512fe-70d6-4fbf-b1fc-ba503ff3c9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.312112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a512fe-70d6-4fbf-b1fc-ba503ff3c9bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.313346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a512fe-70d6-4fbf-b1fc-ba503ff3c9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.314855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a512fe-70d6-4fbf-b1fc-ba503ff3c9bf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.316919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 24/54] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/domains/default => generated 200 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:51.322454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a512fe-70d6-4fbf-b1fc-ba503ff3c9bf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.357648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:51.401961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a03aa-280f-48d6-9826-11df5c4fe4d1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.409160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:51.422586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a512fe-70d6-4fbf-b1fc-ba503ff3c9bf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.435520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd67579-e96f-470d-b0f8-23bfb4344e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.436342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd67579-e96f-470d-b0f8-23bfb4344e8f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.436612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd67579-e96f-470d-b0f8-23bfb4344e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.436888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd67579-e96f-470d-b0f8-23bfb4344e8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.438056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd67579-e96f-470d-b0f8-23bfb4344e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.439529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd67579-e96f-470d-b0f8-23bfb4344e8f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.441758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 31/55] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/domains/default => generated 200 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:51.447677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd67579-e96f-470d-b0f8-23bfb4344e8f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:51.456200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf78659-0fd1-42ff-88c1-8051f7abd300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.457485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf78659-0fd1-42ff-88c1-8051f7abd300 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.457770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf78659-0fd1-42ff-88c1-8051f7abd300 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.458049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf78659-0fd1-42ff-88c1-8051f7abd300 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.458753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf78659-0fd1-42ff-88c1-8051f7abd300 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.460222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf78659-0fd1-42ff-88c1-8051f7abd300 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.546434 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd67579-e96f-470d-b0f8-23bfb4344e8f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:51.561540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 25/56] 10.222.0.123 () {60 vars in 1145 bytes} [Thu May 26 17:50:51 2022] POST /identity/v3/projects => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:50:51.582877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d12b7-9901-4f17-8f09-b8111763c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:51.583756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d12b7-9901-4f17-8f09-b8111763c78a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:51.584040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d12b7-9901-4f17-8f09-b8111763c78a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:51.584347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d12b7-9901-4f17-8f09-b8111763c78a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:51.585200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d12b7-9901-4f17-8f09-b8111763c78a None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.domain.id=default, user.id=a9572da5208c472b8724a85b89731b10) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:51.585512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d12b7-9901-4f17-8f09-b8111763c78a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:51.586994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d12b7-9901-4f17-8f09-b8111763c78a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:51.594405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 32/57] 10.222.0.123 () {56 vars in 1327 bytes} [Thu May 26 17:50:51 2022] GET /identity/v3/role_assignments?user.id=a9572da5208c472b8724a85b89731b10&scope.domain.id=default&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 532 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:50:53.772954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aa531-2eaf-41cd-b5c1-648a4aaa57d1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:53.773475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aa531-2eaf-41cd-b5c1-648a4aaa57d1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:53.773579 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aa531-2eaf-41cd-b5c1-648a4aaa57d1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:53.774857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 26/58] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:53.780270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9050f2-80aa-46e3-a5ab-c163285a5f95 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:53.780683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9050f2-80aa-46e3-a5ab-c163285a5f95 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:53.780851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9050f2-80aa-46e3-a5ab-c163285a5f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:53.797672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-bd9050f2-80aa-46e3-a5ab-c163285a5f95 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:53.798864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bd9050f2-80aa-46e3-a5ab-c163285a5f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:53.828708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:53.864369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 33/59] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:53.889554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aa531-2eaf-41cd-b5c1-648a4aaa57d1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:53.973896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:53.989035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aa531-2eaf-41cd-b5c1-648a4aaa57d1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:54.021925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a6ee-c2d5-4d59-a3ec-f9c7efe57eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:54.022691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a6ee-c2d5-4d59-a3ec-f9c7efe57eab None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:54.023025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a6ee-c2d5-4d59-a3ec-f9c7efe57eab None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:54.023279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a6ee-c2d5-4d59-a3ec-f9c7efe57eab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:54.024465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3a6ee-c2d5-4d59-a3ec-f9c7efe57eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:54.025926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3a6ee-c2d5-4d59-a3ec-f9c7efe57eab None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:54.027522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 27/60] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:53 2022] GET /identity/v3/domains/default => generated 200 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:54.033082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9050f2-80aa-46e3-a5ab-c163285a5f95 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:54.131315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9050f2-80aa-46e3-a5ab-c163285a5f95 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:54.164070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92af47-e11e-42dc-a28e-f4bfb201ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:54.168639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92af47-e11e-42dc-a28e-f4bfb201ff40 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:54.168639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92af47-e11e-42dc-a28e-f4bfb201ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:54.168639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92af47-e11e-42dc-a28e-f4bfb201ff40 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:54.168639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92af47-e11e-42dc-a28e-f4bfb201ff40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:54.168639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92af47-e11e-42dc-a28e-f4bfb201ff40 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:54.373221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 34/61] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:50:54 2022] POST /identity/v3/users => generated 276 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:50:57.806594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddf572-0c4c-4c75-ab3f-01b57543b8e5 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:57.807459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddf572-0c4c-4c75-ab3f-01b57543b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:57.807902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddf572-0c4c-4c75-ab3f-01b57543b8e5 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:57.809453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 28/62] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:57.815043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8187c-dd4b-434e-ab3c-9d0b556f14d0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:57.815871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8187c-dd4b-434e-ab3c-9d0b556f14d0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:57.816331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8187c-dd4b-434e-ab3c-9d0b556f14d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:57.841499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3bf8187c-dd4b-434e-ab3c-9d0b556f14d0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:57.842970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3bf8187c-dd4b-434e-ab3c-9d0b556f14d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:57.862931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:57.925229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17bea-dbe6-485e-a2e9-d5517a508a4e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:57.925661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17bea-dbe6-485e-a2e9-d5517a508a4e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:57.925876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17bea-dbe6-485e-a2e9-d5517a508a4e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:57.927258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 29/63] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:50:57.934465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6460-19b5-461c-be30-3b437acefaa4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:57.934761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6460-19b5-461c-be30-3b437acefaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:57.935047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6460-19b5-461c-be30-3b437acefaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:57.938871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 35/64] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:57.961704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d5cf6460-19b5-461c-be30-3b437acefaa4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:57.963385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d5cf6460-19b5-461c-be30-3b437acefaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:57.966959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8187c-dd4b-434e-ab3c-9d0b556f14d0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.076639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 30/65] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:50:58.077992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d319f-2d78-4d02-9297-f11810d8ede8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.078285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d319f-2d78-4d02-9297-f11810d8ede8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.078564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d319f-2d78-4d02-9297-f11810d8ede8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.080423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 31/66] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:58.094076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762ea5e-a761-470b-822d-9af06104ec05 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.094552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762ea5e-a761-470b-822d-9af06104ec05 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.094964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762ea5e-a761-470b-822d-9af06104ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.096079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8187c-dd4b-434e-ab3c-9d0b556f14d0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.122461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c762ea5e-a761-470b-822d-9af06104ec05 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:58.123973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c762ea5e-a761-470b-822d-9af06104ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:58.135008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ebd24-a348-44a3-9a0a-8dc88b595e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.136082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ebd24-a348-44a3-9a0a-8dc88b595e06 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.136611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ebd24-a348-44a3-9a0a-8dc88b595e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.137034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ebd24-a348-44a3-9a0a-8dc88b595e06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.150731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ebd24-a348-44a3-9a0a-8dc88b595e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f68ebd24-a348-44a3-9a0a-8dc88b595e06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:58.160119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:58.161261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:50:58.162209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:50:58.164260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 36/67] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:58.165277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ebd24-a348-44a3-9a0a-8dc88b595e06 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.182536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:58.202331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 32/68] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:50:58.208329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762ea5e-a761-470b-822d-9af06104ec05 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.236446 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:58.291106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ebd24-a348-44a3-9a0a-8dc88b595e06 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.333088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762ea5e-a761-470b-822d-9af06104ec05 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.335985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03af123-a073-40ca-86fc-7be2e8378c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.338736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af123-a073-40ca-86fc-7be2e8378c08 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.339017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af123-a073-40ca-86fc-7be2e8378c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.339286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af123-a073-40ca-86fc-7be2e8378c08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.350515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03af123-a073-40ca-86fc-7be2e8378c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f03af123-a073-40ca-86fc-7be2e8378c08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:58.358692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:58.359635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:50:58.360431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 37/69] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:58.361365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7dbfe-b8af-4ffa-a2f8-48d3fa30ceee None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.361640 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7dbfe-b8af-4ffa-a2f8-48d3fa30ceee None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.361920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7dbfe-b8af-4ffa-a2f8-48d3fa30ceee None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.363243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 38/70] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:58.363945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7dbfe-b8af-4ffa-a2f8-48d3fa30ceee None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.371947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881167e3-88e7-465c-9259-6a277b673e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.372642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881167e3-88e7-465c-9259-6a277b673e83 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.372929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881167e3-88e7-465c-9259-6a277b673e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.373203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881167e3-88e7-465c-9259-6a277b673e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.373949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881167e3-88e7-465c-9259-6a277b673e83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:58.374253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881167e3-88e7-465c-9259-6a277b673e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:58.375643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881167e3-88e7-465c-9259-6a277b673e83 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:58.384971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 33/71] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:58.386178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53a5f-fd85-46f9-86a4-5a9b63c352c6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.386461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53a5f-fd85-46f9-86a4-5a9b63c352c6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.386735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53a5f-fd85-46f9-86a4-5a9b63c352c6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.387951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 34/72] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:50:58 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:50:58.388662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53a5f-fd85-46f9-86a4-5a9b63c352c6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.453554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:58.467848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:58.479023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7dbfe-b8af-4ffa-a2f8-48d3fa30ceee None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.490885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53a5f-fd85-46f9-86a4-5a9b63c352c6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.512591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d4bb0-3dc0-47fd-8331-a2371c16b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.513385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4bb0-3dc0-47fd-8331-a2371c16b568 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.513669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4bb0-3dc0-47fd-8331-a2371c16b568 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.513949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4bb0-3dc0-47fd-8331-a2371c16b568 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.524208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.527293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.527430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d4bb0-3dc0-47fd-8331-a2371c16b568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:58.527534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.527534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.527534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:58.527534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:58.527855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-986d4bb0-3dc0-47fd-8331-a2371c16b568 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:58.532612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:58.533624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:50:58.534413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 39/73] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:58.535208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297275-79ee-4b5a-92b3-d5a3fe6d5697 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.535279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297275-79ee-4b5a-92b3-d5a3fe6d5697 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.535538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297275-79ee-4b5a-92b3-d5a3fe6d5697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.540861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 35/74] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:58.540861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.553120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6f297275-79ee-4b5a-92b3-d5a3fe6d5697 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:58.554335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6f297275-79ee-4b5a-92b3-d5a3fe6d5697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:58.623624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 40/75] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:58.624892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747f713-4fd5-4db2-ae21-62cd2f2274b2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.625186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747f713-4fd5-4db2-ae21-62cd2f2274b2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.625467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747f713-4fd5-4db2-ae21-62cd2f2274b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.642364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b747f713-4fd5-4db2-ae21-62cd2f2274b2 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:50:58.643549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b747f713-4fd5-4db2-ae21-62cd2f2274b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:50:58.643852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cef950-f022-49de-9720-0c10dee204f8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.680315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e3985-d73e-4e6a-a986-2a709e0a78cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.681222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3985-d73e-4e6a-a986-2a709e0a78cc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.681507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3985-d73e-4e6a-a986-2a709e0a78cc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.681787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3985-d73e-4e6a-a986-2a709e0a78cc None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.690165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:58.697238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e3985-d73e-4e6a-a986-2a709e0a78cc None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:58.700975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e3985-d73e-4e6a-a986-2a709e0a78cc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:58.700975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 36/76] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:58.701363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e3985-d73e-4e6a-a986-2a709e0a78cc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.713980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:58.721794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 41/77] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:50:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:50:58.722947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747f713-4fd5-4db2-ae21-62cd2f2274b2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.800653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e3985-d73e-4e6a-a986-2a709e0a78cc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.826058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747f713-4fd5-4db2-ae21-62cd2f2274b2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.834596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.835268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.835563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.835844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.836624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:58.836939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:58.838332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:58.846492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 37/78] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:58.847334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.860005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089f5ad-203c-4809-a7d1-530d50829ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.860913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089f5ad-203c-4809-a7d1-530d50829ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.861204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089f5ad-203c-4809-a7d1-530d50829ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.861484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089f5ad-203c-4809-a7d1-530d50829ec7 None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:58.863397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089f5ad-203c-4809-a7d1-530d50829ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:58.864884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089f5ad-203c-4809-a7d1-530d50829ec7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:58.866520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 42/79] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:58.867285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089f5ad-203c-4809-a7d1-530d50829ec7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:58.908105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:58.928447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:58.948726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a22bd-84f9-42a7-abed-978dba95fa38 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.966156 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089f5ad-203c-4809-a7d1-530d50829ec7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:58.982193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc590d8-e504-4ae3-9bce-0fd3542bf82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:58.983002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc590d8-e504-4ae3-9bce-0fd3542bf82e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:58.983287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc590d8-e504-4ae3-9bce-0fd3542bf82e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:58.983565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc590d8-e504-4ae3-9bce-0fd3542bf82e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.001041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc590d8-e504-4ae3-9bce-0fd3542bf82e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:50:59.003264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111d52-8628-498a-895e-74301a63d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.004529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111d52-8628-498a-895e-74301a63d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.004820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111d52-8628-498a-895e-74301a63d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.005102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111d52-8628-498a-895e-74301a63d1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-dcc590d8-e504-4ae3-9bce-0fd3542bf82e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:50:59.010913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:50:59.011726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:50:59.012484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 38/80] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:50:59.017969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc590d8-e504-4ae3-9bce-0fd3542bf82e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.080110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111d52-8628-498a-895e-74301a63d1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.081670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111d52-8628-498a-895e-74301a63d1d3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.117908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc590d8-e504-4ae3-9bce-0fd3542bf82e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.134979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.142521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.152219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa45042-a481-4dd6-b4da-2630c6205c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.153207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa45042-a481-4dd6-b4da-2630c6205c08 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.153473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa45042-a481-4dd6-b4da-2630c6205c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.153753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa45042-a481-4dd6-b4da-2630c6205c08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.154936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa45042-a481-4dd6-b4da-2630c6205c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.156452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa45042-a481-4dd6-b4da-2630c6205c08 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.158088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 39/81] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:59.158964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa45042-a481-4dd6-b4da-2630c6205c08 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.183975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 43/82] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:50:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:50:59.184863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111d52-8628-498a-895e-74301a63d1d3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.267274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa45042-a481-4dd6-b4da-2630c6205c08 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.283468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111d52-8628-498a-895e-74301a63d1d3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.302944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d0ef-e3d1-4571-9ec7-4e19135a8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.303814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d0ef-e3d1-4571-9ec7-4e19135a8f14 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.304095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d0ef-e3d1-4571-9ec7-4e19135a8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.304404 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d0ef-e3d1-4571-9ec7-4e19135a8f14 None admin] PATH_INFO: `/v3/users/a9572da5208c472b8724a85b89731b10` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.305611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582d0ef-e3d1-4571-9ec7-4e19135a8f14 None admin] RBAC: Authorizing `identity:get_user(user_id=a9572da5208c472b8724a85b89731b10)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.307082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582d0ef-e3d1-4571-9ec7-4e19135a8f14 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.308736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 40/83] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/users/a9572da5208c472b8724a85b89731b10 => generated 248 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:59.309496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d0ef-e3d1-4571-9ec7-4e19135a8f14 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.324836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef985ed-9c43-4007-84f1-42411222fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.325486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef985ed-9c43-4007-84f1-42411222fe67 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.325769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef985ed-9c43-4007-84f1-42411222fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.326047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef985ed-9c43-4007-84f1-42411222fe67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.355789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.365522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.392500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef985ed-9c43-4007-84f1-42411222fe67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.394532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef985ed-9c43-4007-84f1-42411222fe67 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.408147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d0ef-e3d1-4571-9ec7-4e19135a8f14 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.442340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.442936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.443217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.443499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.444236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:50:59.444570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.445960 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.454037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 41/84] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:59.454793 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.495382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 44/85] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:50:59.496233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef985ed-9c43-4007-84f1-42411222fe67 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.557170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a584-8d3f-4fa5-8301-8ca7ae0de1a6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.557846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.573497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.590681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa79ae-ba60-47b6-83e0-346a3a741740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.591347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa79ae-ba60-47b6-83e0-346a3a741740 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.591632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa79ae-ba60-47b6-83e0-346a3a741740 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.591907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa79ae-ba60-47b6-83e0-346a3a741740 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.592645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa79ae-ba60-47b6-83e0-346a3a741740 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.594117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa79ae-ba60-47b6-83e0-346a3a741740 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.595490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef985ed-9c43-4007-84f1-42411222fe67 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.630111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859f3e-7cb0-4953-8b43-f3e18e6c3d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.630960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859f3e-7cb0-4953-8b43-f3e18e6c3d4c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.631244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859f3e-7cb0-4953-8b43-f3e18e6c3d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.631517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859f3e-7cb0-4953-8b43-f3e18e6c3d4c None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.632706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8859f3e-7cb0-4953-8b43-f3e18e6c3d4c None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.634245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8859f3e-7cb0-4953-8b43-f3e18e6c3d4c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.635933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 45/86] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:59.636701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859f3e-7cb0-4953-8b43-f3e18e6c3d4c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.732746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859f3e-7cb0-4953-8b43-f3e18e6c3d4c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.750270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 42/87] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:50:59 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:50:59.753907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa79ae-ba60-47b6-83e0-346a3a741740 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.771808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.780070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b5125-9609-405a-b558-3b088ad92373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.781506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b5125-9609-405a-b558-3b088ad92373 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.781798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b5125-9609-405a-b558-3b088ad92373 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.782109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b5125-9609-405a-b558-3b088ad92373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.857016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b5125-9609-405a-b558-3b088ad92373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.858539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b5125-9609-405a-b558-3b088ad92373 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.873792 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa79ae-ba60-47b6-83e0-346a3a741740 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:50:59.914053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42dcec-2513-403a-89ee-fd01e59882bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:50:59.914956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42dcec-2513-403a-89ee-fd01e59882bc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:50:59.915240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42dcec-2513-403a-89ee-fd01e59882bc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:50:59.915519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42dcec-2513-403a-89ee-fd01e59882bc None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:50:59.916990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42dcec-2513-403a-89ee-fd01e59882bc None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:50:59.918529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42dcec-2513-403a-89ee-fd01e59882bc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:50:59.925005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 43/88] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:50:59.925005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42dcec-2513-403a-89ee-fd01e59882bc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:50:59.977725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:50:59.986842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 46/89] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:50:59.988582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b5125-9609-405a-b558-3b088ad92373 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:00.029994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:00.054408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42dcec-2513-403a-89ee-fd01e59882bc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:00.103238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c1f15-0017-48a7-9190-274c7a95d142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:00.104108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1f15-0017-48a7-9190-274c7a95d142 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:00.105441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1f15-0017-48a7-9190-274c7a95d142 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:00.105441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1f15-0017-48a7-9190-274c7a95d142 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:00.107497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c1f15-0017-48a7-9190-274c7a95d142 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:00.107616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c1f15-0017-48a7-9190-274c7a95d142 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:00.109573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 44/90] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:00.110145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c1f15-0017-48a7-9190-274c7a95d142 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:00.117662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b5125-9609-405a-b558-3b088ad92373 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:00.196468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:00.197574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:00.197864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:00.198169 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:00.199323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] RBAC: Adding query filter params (role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=6a5c72aa29764ef48849de4944696987, user.id=dac67488793242039b05e7d68aa8f739) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:00.199645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:00.201409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:00.215294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 47/91] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:50:59 2022] GET /identity/v3/role_assignments?user.id=dac67488793242039b05e7d68aa8f739&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:00.215294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:00.318308 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c1f15-0017-48a7-9190-274c7a95d142 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:00.334650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:00.389158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ca6d-8d5a-4df3-9718-3ed9bc44a161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:00.389836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ca6d-8d5a-4df3-9718-3ed9bc44a161 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:00.390122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ca6d-8d5a-4df3-9718-3ed9bc44a161 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:00.390404 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ca6d-8d5a-4df3-9718-3ed9bc44a161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:00.397490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:00.411570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7ecf0-8cb6-4386-8ea4-afef94b83995 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:00.487001 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87cdcc-ce2e-4514-979d-be63e13603fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:00.488514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87cdcc-ce2e-4514-979d-be63e13603fb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:00.488796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87cdcc-ce2e-4514-979d-be63e13603fb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:00.489073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87cdcc-ce2e-4514-979d-be63e13603fb None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:00.490630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87cdcc-ce2e-4514-979d-be63e13603fb None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:00.492080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87cdcc-ce2e-4514-979d-be63e13603fb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:00.493832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 48/92] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:00 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:00.494604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87cdcc-ce2e-4514-979d-be63e13603fb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:00.565452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32ca6d-8d5a-4df3-9718-3ed9bc44a161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:00.566911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32ca6d-8d5a-4df3-9718-3ed9bc44a161 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:00.624268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87cdcc-ce2e-4514-979d-be63e13603fb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:00.665267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:00.665988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:00.666276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:00.666591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:00.667491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] RBAC: Adding query filter params (role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=6a5c72aa29764ef48849de4944696987, user.id=dac67488793242039b05e7d68aa8f739) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:00.667812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:00.669353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:00.677921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 49/93] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:00 2022] GET /identity/v3/role_assignments?user.id=dac67488793242039b05e7d68aa8f739&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=6b666ed01b97482497ff1f656ecff898 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:00.678583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:00.712278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:00.803050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596fecc-dad3-4f29-9f5d-e050838b3b91 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:00.845117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:00.845697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:00.845986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:00.846314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:00.847806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=6a5c72aa29764ef48849de4944696987, user.id=a9572da5208c472b8724a85b89731b10) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:00.848076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:00.849821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:00.850638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 45/94] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:00.860343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 50/95] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:00 2022] GET /identity/v3/role_assignments?user.id=a9572da5208c472b8724a85b89731b10&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:00.860888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ca6d-8d5a-4df3-9718-3ed9bc44a161 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:00.869560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:01.009415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ca6d-8d5a-4df3-9718-3ed9bc44a161 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:01.060328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0060085-e398-44d7-a3a1-b9f4f0b28d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:01.061227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0060085-e398-44d7-a3a1-b9f4f0b28d92 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:01.061510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0060085-e398-44d7-a3a1-b9f4f0b28d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:01.061785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0060085-e398-44d7-a3a1-b9f4f0b28d92 None admin] PATH_INFO: `/v3/projects/96ccd6f11ea24c06bca7f357b34f5961` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:01.063016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0060085-e398-44d7-a3a1-b9f4f0b28d92 None admin] RBAC: Authorizing `identity:get_project(project_id=96ccd6f11ea24c06bca7f357b34f5961)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:01.065786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0060085-e398-44d7-a3a1-b9f4f0b28d92 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:01.068146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 46/96] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:00 2022] GET /identity/v3/projects/96ccd6f11ea24c06bca7f357b34f5961 => generated 313 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:01.072955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:01.187799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:01.199188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5c05d-fa41-4229-85ee-2de69a2074a9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:01.245131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe6e81-7a19-4ab6-8280-a0eb59a420d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:01.246184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6e81-7a19-4ab6-8280-a0eb59a420d3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:01.246672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6e81-7a19-4ab6-8280-a0eb59a420d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:01.247150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6e81-7a19-4ab6-8280-a0eb59a420d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:01.248252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe6e81-7a19-4ab6-8280-a0eb59a420d3 None admin] RBAC: Adding query filter params (role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=96ccd6f11ea24c06bca7f357b34f5961, user.id=dac67488793242039b05e7d68aa8f739) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:01.248810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe6e81-7a19-4ab6-8280-a0eb59a420d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:01.251956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe6e81-7a19-4ab6-8280-a0eb59a420d3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:01.259567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 51/97] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:01 2022] GET /identity/v3/role_assignments?user.id=dac67488793242039b05e7d68aa8f739&scope.project.id=96ccd6f11ea24c06bca7f357b34f5961&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:02.787004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9184-c48e-447d-b6cf-ce170721bf0d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:02.787508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9184-c48e-447d-b6cf-ce170721bf0d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:02.787583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9184-c48e-447d-b6cf-ce170721bf0d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:02.789085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 47/98] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:02.802511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5986e-1d83-43c1-a7ba-8fd137b655cb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:02.803373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5986e-1d83-43c1-a7ba-8fd137b655cb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:02.803853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5986e-1d83-43c1-a7ba-8fd137b655cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:02.841335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f8c5986e-1d83-43c1-a7ba-8fd137b655cb None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:02.842870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f8c5986e-1d83-43c1-a7ba-8fd137b655cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:02.935393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 52/99] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:02.977898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce9184-c48e-447d-b6cf-ce170721bf0d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:03.056343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3975f3-de8b-4b80-86c8-06ac4a161765 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.056998 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3975f3-de8b-4b80-86c8-06ac4a161765 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.057477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3975f3-de8b-4b80-86c8-06ac4a161765 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.059049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 53/100] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:03.067354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcaad9-302a-4b7b-a7bd-28f96a5af4d9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.067938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcaad9-302a-4b7b-a7bd-28f96a5af4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.068509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcaad9-302a-4b7b-a7bd-28f96a5af4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.134424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:03.143350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f6fcaad9-302a-4b7b-a7bd-28f96a5af4d9 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:03.145506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f6fcaad9-302a-4b7b-a7bd-28f96a5af4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:03.189985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce9184-c48e-447d-b6cf-ce170721bf0d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:03.265044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bdee8-b325-4a04-92d1-496800f1d3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:03.265844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bdee8-b325-4a04-92d1-496800f1d3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.266134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bdee8-b325-4a04-92d1-496800f1d3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.266422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bdee8-b325-4a04-92d1-496800f1d3c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.268143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 54/101] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:03.291647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bdee8-b325-4a04-92d1-496800f1d3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-643bdee8-b325-4a04-92d1-496800f1d3c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:03.304326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:03.305183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:03.305920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 48/102] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:03.310193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcaad9-302a-4b7b-a7bd-28f96a5af4d9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:03.341702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bdee8-b325-4a04-92d1-496800f1d3c4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:03.344552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:03.488199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bdee8-b325-4a04-92d1-496800f1d3c4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:03.526140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcaad9-302a-4b7b-a7bd-28f96a5af4d9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:03.548401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe5883-6e1d-4a2d-9091-2b9eb4363b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:03.549196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe5883-6e1d-4a2d-9091-2b9eb4363b24 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.549476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe5883-6e1d-4a2d-9091-2b9eb4363b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.549747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe5883-6e1d-4a2d-9091-2b9eb4363b24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.551268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe5883-6e1d-4a2d-9091-2b9eb4363b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:03.552762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe5883-6e1d-4a2d-9091-2b9eb4363b24 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:03.554389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 49/103] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:03 2022] GET /identity/v3/domains/default => generated 200 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:03.559797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9b98-97a7-4324-a575-809841a84343 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.563431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9b98-97a7-4324-a575-809841a84343 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.563681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d9b98-97a7-4324-a575-809841a84343 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.565099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 50/104] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:03 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:03.567772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d9b98-97a7-4324-a575-809841a84343 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:03.588664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:03.590891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507954-3925-4925-8b38-8544b1c16ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:03.591630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507954-3925-4925-8b38-8544b1c16ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.591914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507954-3925-4925-8b38-8544b1c16ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.593013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507954-3925-4925-8b38-8544b1c16ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.593979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3507954-3925-4925-8b38-8544b1c16ce6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:03.594295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3507954-3925-4925-8b38-8544b1c16ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:03.595688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3507954-3925-4925-8b38-8544b1c16ce6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:03.611727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 55/105] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:03 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:03.614552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af8f9-df65-4d89-b5cb-d2aee743e5be None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.614842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af8f9-df65-4d89-b5cb-d2aee743e5be None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.615118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af8f9-df65-4d89-b5cb-d2aee743e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.639102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7b3af8f9-df65-4d89-b5cb-d2aee743e5be None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:03.640286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7b3af8f9-df65-4d89-b5cb-d2aee743e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:03.760719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 56/106] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:03.762369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af8f9-df65-4d89-b5cb-d2aee743e5be None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:03.776668 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:03.793998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d9b98-97a7-4324-a575-809841a84343 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:03.875500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca29ab5-6b51-4f9e-abcf-231d1d3243ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:03.876397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca29ab5-6b51-4f9e-abcf-231d1d3243ae None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.877106 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca29ab5-6b51-4f9e-abcf-231d1d3243ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.879519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca29ab5-6b51-4f9e-abcf-231d1d3243ae None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.880407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca29ab5-6b51-4f9e-abcf-231d1d3243ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:03.882007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca29ab5-6b51-4f9e-abcf-231d1d3243ae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:03.908351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af8f9-df65-4d89-b5cb-d2aee743e5be None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:03.941530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e5bf0-fbd5-487e-83bc-dd25ea748aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:03.942424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5bf0-fbd5-487e-83bc-dd25ea748aaf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:03.942761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5bf0-fbd5-487e-83bc-dd25ea748aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:03.943046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5bf0-fbd5-487e-83bc-dd25ea748aaf None admin] PATH_INFO: `/v3/users/34f0d636c2604b9eb348539a21b6251f` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:03.960563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e5bf0-fbd5-487e-83bc-dd25ea748aaf None admin] RBAC: Authorizing `identity:get_user(user_id=34f0d636c2604b9eb348539a21b6251f)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:03.962039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e5bf0-fbd5-487e-83bc-dd25ea748aaf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:03.964139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 57/107] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:03 2022] GET /identity/v3/users/34f0d636c2604b9eb348539a21b6251f => generated 290 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:03.964961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e5bf0-fbd5-487e-83bc-dd25ea748aaf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:04.000482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 51/108] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:51:03 2022] POST /identity/v3/projects => generated 303 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:04.002153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca29ab5-6b51-4f9e-abcf-231d1d3243ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:04.054064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:04.091282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e5bf0-fbd5-487e-83bc-dd25ea748aaf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:04.187450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:04.201114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11560c-4611-40e8-9a5c-8666fb6282ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:04.201958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11560c-4611-40e8-9a5c-8666fb6282ba None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.206092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11560c-4611-40e8-9a5c-8666fb6282ba None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.206092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11560c-4611-40e8-9a5c-8666fb6282ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.220840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11560c-4611-40e8-9a5c-8666fb6282ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:04.237905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca29ab5-6b51-4f9e-abcf-231d1d3243ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6c11560c-4611-40e8-9a5c-8666fb6282ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:04.238090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:04.240941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 58/109] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:04.241689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075214-f71e-4875-bd6c-40e3ce30477e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.242357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075214-f71e-4875-bd6c-40e3ce30477e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.242357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075214-f71e-4875-bd6c-40e3ce30477e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.242468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 59/110] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:04.253972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e075214-f71e-4875-bd6c-40e3ce30477e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:04.301191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45b605-327d-45ef-ad50-2c0a806ba5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:04.302288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45b605-327d-45ef-ad50-2c0a806ba5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.302773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45b605-327d-45ef-ad50-2c0a806ba5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.303248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45b605-327d-45ef-ad50-2c0a806ba5e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.396190 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45b605-327d-45ef-ad50-2c0a806ba5e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:04.397743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45b605-327d-45ef-ad50-2c0a806ba5e5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:04.410431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e075214-f71e-4875-bd6c-40e3ce30477e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:04.461421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:04.466390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:04.468030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c628ec2-614b-4a6d-84aa-314394418d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:04.469312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c628ec2-614b-4a6d-84aa-314394418d31 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.470125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c628ec2-614b-4a6d-84aa-314394418d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.470776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c628ec2-614b-4a6d-84aa-314394418d31 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.471819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c628ec2-614b-4a6d-84aa-314394418d31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:04.472495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c628ec2-614b-4a6d-84aa-314394418d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:04.474704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c628ec2-614b-4a6d-84aa-314394418d31 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:04.486135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 60/111] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:04 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:04.492196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d03a1e-f1f5-4a97-a6a7-cab31499e2b7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.492196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d03a1e-f1f5-4a97-a6a7-cab31499e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.492196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d03a1e-f1f5-4a97-a6a7-cab31499e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.513938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a2d03a1e-f1f5-4a97-a6a7-cab31499e2b7 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:04.515136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a2d03a1e-f1f5-4a97-a6a7-cab31499e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:04.527114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 52/112] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:04.527114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050d88-3473-4575-bc4d-c2c470b682c7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.527114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050d88-3473-4575-bc4d-c2c470b682c7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.527114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050d88-3473-4575-bc4d-c2c470b682c7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.527114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 53/113] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:04.527114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050d88-3473-4575-bc4d-c2c470b682c7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:04.594318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 61/114] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:04.595658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee5b2-0f73-4f81-974e-8329605248f2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.595947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee5b2-0f73-4f81-974e-8329605248f2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.596224 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecee5b2-0f73-4f81-974e-8329605248f2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.598013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 62/115] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:04.601305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecee5b2-0f73-4f81-974e-8329605248f2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:04.646620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050d88-3473-4575-bc4d-c2c470b682c7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:04.682663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a614-f5ca-4bc2-bb02-f85fa5c21db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:04.683539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a614-f5ca-4bc2-bb02-f85fa5c21db0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.683820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a614-f5ca-4bc2-bb02-f85fa5c21db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.684100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a614-f5ca-4bc2-bb02-f85fa5c21db0 None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.685382 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7a614-f5ca-4bc2-bb02-f85fa5c21db0 None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:04.686827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7a614-f5ca-4bc2-bb02-f85fa5c21db0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:04.688485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 54/116] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:04 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:04.693455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173701d-4c9b-4ec4-b69b-ee900d3e1bb9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.693836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173701d-4c9b-4ec4-b69b-ee900d3e1bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.694121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173701d-4c9b-4ec4-b69b-ee900d3e1bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.712163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7173701d-4c9b-4ec4-b69b-ee900d3e1bb9 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:04.713297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7173701d-4c9b-4ec4-b69b-ee900d3e1bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:04.725041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecee5b2-0f73-4f81-974e-8329605248f2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:04.730671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:04.746924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:04.766217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30293f2a-282e-4291-88b3-5ce7e9856327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:04.767079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30293f2a-282e-4291-88b3-5ce7e9856327 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.767360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30293f2a-282e-4291-88b3-5ce7e9856327 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.767634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30293f2a-282e-4291-88b3-5ce7e9856327 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.769464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30293f2a-282e-4291-88b3-5ce7e9856327 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:04.770922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30293f2a-282e-4291-88b3-5ce7e9856327 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:04.777641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 63/117] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:04 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:04.777641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1703b-52bd-4a42-bd6e-c172a5e1feab None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.777641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1703b-52bd-4a42-bd6e-c172a5e1feab None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.777641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1703b-52bd-4a42-bd6e-c172a5e1feab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.790750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 55/118] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:04.791450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173701d-4c9b-4ec4-b69b-ee900d3e1bb9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:04.809503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e3d1703b-52bd-4a42-bd6e-c172a5e1feab None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:04.811462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e3d1703b-52bd-4a42-bd6e-c172a5e1feab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:04.888743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 64/119] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:04.889608 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1703b-52bd-4a42-bd6e-c172a5e1feab None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:04.906478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173701d-4c9b-4ec4-b69b-ee900d3e1bb9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:04.946071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891379c-310b-4df9-af0d-d419393c1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:04.946889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891379c-310b-4df9-af0d-d419393c1885 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:04.947175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891379c-310b-4df9-af0d-d419393c1885 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:04.947459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891379c-310b-4df9-af0d-d419393c1885 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:04.958639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891379c-310b-4df9-af0d-d419393c1885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3891379c-310b-4df9-af0d-d419393c1885 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:04.966828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:04.967978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 56/120] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:04.969539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891379c-310b-4df9-af0d-d419393c1885 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:04.988439 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.009182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1703b-52bd-4a42-bd6e-c172a5e1feab None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.024231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.045681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afefc4-a7d7-4946-bb36-06e539bfeb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.046546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afefc4-a7d7-4946-bb36-06e539bfeb97 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.046833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afefc4-a7d7-4946-bb36-06e539bfeb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.047109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afefc4-a7d7-4946-bb36-06e539bfeb97 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.048396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afefc4-a7d7-4946-bb36-06e539bfeb97 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.049860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afefc4-a7d7-4946-bb36-06e539bfeb97 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.056949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 65/121] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:04 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:05.056949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afefc4-a7d7-4946-bb36-06e539bfeb97 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.081950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891379c-310b-4df9-af0d-d419393c1885 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.123549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.124332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.124641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.124919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.125982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] RBAC: Adding query filter params (role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36, scope.project.id=6a5c72aa29764ef48849de4944696987, user.id=34f0d636c2604b9eb348539a21b6251f) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:05.126348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.128245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.135862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 57/122] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:04 2022] GET /identity/v3/role_assignments?user.id=34f0d636c2604b9eb348539a21b6251f&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:05.136730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.193941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afefc4-a7d7-4946-bb36-06e539bfeb97 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.231986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.249854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bad86-0d8b-4384-9239-8743df76aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.251887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bad86-0d8b-4384-9239-8743df76aca4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.252413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bad86-0d8b-4384-9239-8743df76aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.253028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bad86-0d8b-4384-9239-8743df76aca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.256758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbd430-cc0b-4218-b137-85a08f1e4700 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.268742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bad86-0d8b-4384-9239-8743df76aca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f52bad86-0d8b-4384-9239-8743df76aca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:05.279542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:05.280624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:05.281566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:05.285325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 66/123] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:05.286436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bad86-0d8b-4384-9239-8743df76aca4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.309670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be064cd7-3ef4-463f-b221-7f7b2d638ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.310392 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064cd7-3ef4-463f-b221-7f7b2d638ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.310678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064cd7-3ef4-463f-b221-7f7b2d638ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.310959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064cd7-3ef4-463f-b221-7f7b2d638ec0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.323865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be064cd7-3ef4-463f-b221-7f7b2d638ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-be064cd7-3ef4-463f-b221-7f7b2d638ec0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:05.332950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:05.333836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:05.334593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 58/124] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:05.335840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be064cd7-3ef4-463f-b221-7f7b2d638ec0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.341232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.406436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bad86-0d8b-4384-9239-8743df76aca4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.444727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.445746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.446232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.446760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.447812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:05.448345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.449933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.459822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 67/125] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:05.460991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.462371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be064cd7-3ef4-463f-b221-7f7b2d638ec0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.499610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92388649-9f74-47eb-a197-5baecc3f3ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.500016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92388649-9f74-47eb-a197-5baecc3f3ae5 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.500316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92388649-9f74-47eb-a197-5baecc3f3ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.500598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92388649-9f74-47eb-a197-5baecc3f3ae5 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987/users/dac67488793242039b05e7d68aa8f739/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.502940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92388649-9f74-47eb-a197-5baecc3f3ae5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c72aa29764ef48849de4944696987, user_id=dac67488793242039b05e7d68aa8f739, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.504998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92388649-9f74-47eb-a197-5baecc3f3ae5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.569702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddaae4-6755-4761-a0c8-3e730092881e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.572868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.596026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.605941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 59/126] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:05 2022] PUT /identity/v3/projects/6a5c72aa29764ef48849de4944696987/users/dac67488793242039b05e7d68aa8f739/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:05.614073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92388649-9f74-47eb-a197-5baecc3f3ae5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.614210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.614210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.614381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.614632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.615415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:05.615728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.617184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.631198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 68/127] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:05.632463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.773010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92388649-9f74-47eb-a197-5baecc3f3ae5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.814190 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.815093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.815480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.816466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.817343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:05.818059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.819773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.831269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 60/128] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:05.832856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.856932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46897b37-ed2f-4d13-b6b2-6848bea50df9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:05.902774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28f62f-361a-46be-aad6-dc532d819e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:05.903654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28f62f-361a-46be-aad6-dc532d819e0f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:05.903932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28f62f-361a-46be-aad6-dc532d819e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:05.904201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28f62f-361a-46be-aad6-dc532d819e0f None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:05.905455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28f62f-361a-46be-aad6-dc532d819e0f None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:05.906920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28f62f-361a-46be-aad6-dc532d819e0f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:05.909640 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 69/129] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:05.910454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28f62f-361a-46be-aad6-dc532d819e0f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:05.920831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.955450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:05.966709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e0f0-2224-41bf-ad0c-81ef01d6e43a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.010114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78a88-c7a6-4803-aaec-0b4b943767e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.011117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78a88-c7a6-4803-aaec-0b4b943767e2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.011404 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78a88-c7a6-4803-aaec-0b4b943767e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.011733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78a88-c7a6-4803-aaec-0b4b943767e2 None admin] PATH_INFO: `/v3/users/a9572da5208c472b8724a85b89731b10` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.013604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78a88-c7a6-4803-aaec-0b4b943767e2 None admin] RBAC: Authorizing `identity:get_user(user_id=a9572da5208c472b8724a85b89731b10)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.015083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78a88-c7a6-4803-aaec-0b4b943767e2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.021184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 61/130] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/users/a9572da5208c472b8724a85b89731b10 => generated 248 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:06.022846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78a88-c7a6-4803-aaec-0b4b943767e2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:06.092195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28f62f-361a-46be-aad6-dc532d819e0f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.132139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0a15-67ca-414f-b82a-8976d341efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.137169 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0a15-67ca-414f-b82a-8976d341efbc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.137492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0a15-67ca-414f-b82a-8976d341efbc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.137773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0a15-67ca-414f-b82a-8976d341efbc None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.139080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b0a15-67ca-414f-b82a-8976d341efbc None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.140580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b0a15-67ca-414f-b82a-8976d341efbc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.146268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 70/131] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:05 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:06.147032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0a15-67ca-414f-b82a-8976d341efbc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:06.249401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78a88-c7a6-4803-aaec-0b4b943767e2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.291880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:06.299467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce78b6-a575-437d-892a-a016b9203844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.301127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce78b6-a575-437d-892a-a016b9203844 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.301683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce78b6-a575-437d-892a-a016b9203844 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.302059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce78b6-a575-437d-892a-a016b9203844 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.303454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce78b6-a575-437d-892a-a016b9203844 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.305048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce78b6-a575-437d-892a-a016b9203844 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.307017 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 62/132] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:06 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:06.307813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce78b6-a575-437d-892a-a016b9203844 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:06.330758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0a15-67ca-414f-b82a-8976d341efbc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.333170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:06.384361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66385a54-f519-4d82-8130-bca00a743f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.385160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385a54-f519-4d82-8130-bca00a743f6a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.385446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385a54-f519-4d82-8130-bca00a743f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.385721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385a54-f519-4d82-8130-bca00a743f6a None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.386924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66385a54-f519-4d82-8130-bca00a743f6a None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.388384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66385a54-f519-4d82-8130-bca00a743f6a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.390274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 71/133] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:06 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:06.391008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66385a54-f519-4d82-8130-bca00a743f6a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:06.546836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce78b6-a575-437d-892a-a016b9203844 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.552236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66385a54-f519-4d82-8130-bca00a743f6a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.609769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f936-b327-4859-b84b-c79643888208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.610627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f936-b327-4859-b84b-c79643888208 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.610908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f936-b327-4859-b84b-c79643888208 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.611182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f936-b327-4859-b84b-c79643888208 None admin] PATH_INFO: `/v3/projects/96ccd6f11ea24c06bca7f357b34f5961` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.614942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f936-b327-4859-b84b-c79643888208 None admin] RBAC: Authorizing `identity:get_project(project_id=96ccd6f11ea24c06bca7f357b34f5961)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.616454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f936-b327-4859-b84b-c79643888208 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.618174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 63/134] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:06 2022] GET /identity/v3/projects/96ccd6f11ea24c06bca7f357b34f5961 => generated 313 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:06.618921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f936-b327-4859-b84b-c79643888208 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:06.621232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494e86-430f-44a1-93b3-03bbd45cb24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.622672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494e86-430f-44a1-93b3-03bbd45cb24a None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.623161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494e86-430f-44a1-93b3-03bbd45cb24a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.623616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11494e86-430f-44a1-93b3-03bbd45cb24a None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987/users/dac67488793242039b05e7d68aa8f739/roles/6b666ed01b97482497ff1f656ecff898` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.628553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11494e86-430f-44a1-93b3-03bbd45cb24a None admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c72aa29764ef48849de4944696987, user_id=dac67488793242039b05e7d68aa8f739, role_id=6b666ed01b97482497ff1f656ecff898)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.630167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11494e86-430f-44a1-93b3-03bbd45cb24a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.702861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:06.741733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f936-b327-4859-b84b-c79643888208 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.746409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 72/135] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:06 2022] PUT /identity/v3/projects/6a5c72aa29764ef48849de4944696987/users/dac67488793242039b05e7d68aa8f739/roles/6b666ed01b97482497ff1f656ecff898 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:06.747398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494e86-430f-44a1-93b3-03bbd45cb24a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:06.780163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67bff9-5eba-49b1-9f02-e9220a4a4623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.781198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67bff9-5eba-49b1-9f02-e9220a4a4623 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.781493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67bff9-5eba-49b1-9f02-e9220a4a4623 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.781825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67bff9-5eba-49b1-9f02-e9220a4a4623 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987/users/a9572da5208c472b8724a85b89731b10/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.784274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67bff9-5eba-49b1-9f02-e9220a4a4623 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c72aa29764ef48849de4944696987, user_id=a9572da5208c472b8724a85b89731b10, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.786375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67bff9-5eba-49b1-9f02-e9220a4a4623 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.790927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:06.874252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11494e86-430f-44a1-93b3-03bbd45cb24a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:06.913194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018345e-ed2f-42b1-9f4c-38b0e2181804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:06.914161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018345e-ed2f-42b1-9f4c-38b0e2181804 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.914449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018345e-ed2f-42b1-9f4c-38b0e2181804 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.914726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018345e-ed2f-42b1-9f4c-38b0e2181804 None admin] PATH_INFO: `/v3/projects/96ccd6f11ea24c06bca7f357b34f5961/users/dac67488793242039b05e7d68aa8f739/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.916821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018345e-ed2f-42b1-9f4c-38b0e2181804 None admin] RBAC: Authorizing `identity:create_grant(project_id=96ccd6f11ea24c06bca7f357b34f5961, user_id=dac67488793242039b05e7d68aa8f739, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:06.918429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018345e-ed2f-42b1-9f4c-38b0e2181804 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:06.961850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 64/136] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:06 2022] PUT /identity/v3/projects/6a5c72aa29764ef48849de4944696987/users/a9572da5208c472b8724a85b89731b10/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:06.963241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d23c-9aac-457c-9096-ba8592eb734b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.963546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d23c-9aac-457c-9096-ba8592eb734b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.963830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d23c-9aac-457c-9096-ba8592eb734b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.965778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 65/137] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:06.971636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e74f4-544c-49fb-8d3f-f72f84c3b639 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:06.972039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e74f4-544c-49fb-8d3f-f72f84c3b639 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:06.972350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e74f4-544c-49fb-8d3f-f72f84c3b639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:06.992665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f43e74f4-544c-49fb-8d3f-f72f84c3b639 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:06.993905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f43e74f4-544c-49fb-8d3f-f72f84c3b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:07.074555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 66/138] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:07.101398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e74f4-544c-49fb-8d3f-f72f84c3b639 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:07.149916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 73/139] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:06 2022] PUT /identity/v3/projects/96ccd6f11ea24c06bca7f357b34f5961/users/dac67488793242039b05e7d68aa8f739/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:07.180847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:07.225268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e74f4-544c-49fb-8d3f-f72f84c3b639 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:07.264092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcdb3d-9788-48b5-a9b8-987aca7b01e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:07.264942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcdb3d-9788-48b5-a9b8-987aca7b01e6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:07.265268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcdb3d-9788-48b5-a9b8-987aca7b01e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:07.265547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcdb3d-9788-48b5-a9b8-987aca7b01e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:07.267195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcdb3d-9788-48b5-a9b8-987aca7b01e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:07.269630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcdb3d-9788-48b5-a9b8-987aca7b01e6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:07.271739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 67/140] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:07 2022] GET /identity/v3/domains/default => generated 200 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:07.277750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018345e-ed2f-42b1-9f4c-38b0e2181804 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:07.402608 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:07.412948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018345e-ed2f-42b1-9f4c-38b0e2181804 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:07.449092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466c4af-0b5f-4233-b8e8-a6f17a730fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:07.449780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466c4af-0b5f-4233-b8e8-a6f17a730fbf None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:07.450065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466c4af-0b5f-4233-b8e8-a6f17a730fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:07.450344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466c4af-0b5f-4233-b8e8-a6f17a730fbf None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:07.451063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466c4af-0b5f-4233-b8e8-a6f17a730fbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:07.452548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466c4af-0b5f-4233-b8e8-a6f17a730fbf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:07.555726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 74/141] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:07 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:07.791421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7cf3-0dc5-46d5-b772-fca5adf75979 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:07.791788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7cf3-0dc5-46d5-b772-fca5adf75979 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:07.791950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7cf3-0dc5-46d5-b772-fca5adf75979 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:07.793593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 68/142] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:07.799127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7369-3cd2-4660-bb89-df0113da1b7f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:07.799429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7369-3cd2-4660-bb89-df0113da1b7f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:07.799672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7369-3cd2-4660-bb89-df0113da1b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:07.825630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-963a7369-3cd2-4660-bb89-df0113da1b7f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:07.826778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-963a7369-3cd2-4660-bb89-df0113da1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:07.900721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 75/143] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:07.922824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7cf3-0dc5-46d5-b772-fca5adf75979 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.048512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7cf3-0dc5-46d5-b772-fca5adf75979 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:08.084025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:08.095933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712901bc-aa50-4ac2-a610-3b05a24a7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:08.097030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712901bc-aa50-4ac2-a610-3b05a24a7df5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.097517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712901bc-aa50-4ac2-a610-3b05a24a7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.098037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712901bc-aa50-4ac2-a610-3b05a24a7df5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.110970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712901bc-aa50-4ac2-a610-3b05a24a7df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-712901bc-aa50-4ac2-a610-3b05a24a7df5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:08.119356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:08.120329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:08.121506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 69/144] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:08.126582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7369-3cd2-4660-bb89-df0113da1b7f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.242802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:08.276701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7369-3cd2-4660-bb89-df0113da1b7f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:08.323991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c776df5-010b-475d-9625-9966561e4b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:08.324686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776df5-010b-475d-9625-9966561e4b2e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.324966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776df5-010b-475d-9625-9966561e4b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.325237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776df5-010b-475d-9625-9966561e4b2e None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.325981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c776df5-010b-475d-9625-9966561e4b2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:08.326285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c776df5-010b-475d-9625-9966561e4b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:08.337109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c776df5-010b-475d-9625-9966561e4b2e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:08.340609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 76/145] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:08 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:08.346271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712901bc-aa50-4ac2-a610-3b05a24a7df5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.475633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625d3c-e395-481d-89ea-9214c4762358 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.475939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625d3c-e395-481d-89ea-9214c4762358 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.476245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625d3c-e395-481d-89ea-9214c4762358 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.477812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 77/146] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:51:08.485888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a598-a76d-4e48-8068-11ca9685d47e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.486192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a598-a76d-4e48-8068-11ca9685d47e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.486437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a598-a76d-4e48-8068-11ca9685d47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.492736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712901bc-aa50-4ac2-a610-3b05a24a7df5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:08.512688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c7f2a598-a76d-4e48-8068-11ca9685d47e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:08.513892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c7f2a598-a76d-4e48-8068-11ca9685d47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:08.557582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aecf9-cdc1-4bcf-af6f-580fe4d67054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:08.558467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aecf9-cdc1-4bcf-af6f-580fe4d67054 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.558755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aecf9-cdc1-4bcf-af6f-580fe4d67054 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.559033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aecf9-cdc1-4bcf-af6f-580fe4d67054 None admin] PATH_INFO: `/v3/users/34f0d636c2604b9eb348539a21b6251f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.560782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aecf9-cdc1-4bcf-af6f-580fe4d67054 None admin] RBAC: Authorizing `identity:get_user(user_id=34f0d636c2604b9eb348539a21b6251f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:08.562277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aecf9-cdc1-4bcf-af6f-580fe4d67054 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:08.563958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 70/147] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:08 2022] GET /identity/v3/users/34f0d636c2604b9eb348539a21b6251f => generated 290 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:08.582357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aecf9-cdc1-4bcf-af6f-580fe4d67054 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.601129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 78/148] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:08.641720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2a598-a76d-4e48-8068-11ca9685d47e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.652860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:08.710048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aecf9-cdc1-4bcf-af6f-580fe4d67054 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:08.748223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61b01-dfac-4554-bffe-a046b079cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:08.749145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61b01-dfac-4554-bffe-a046b079cb8e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.749427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61b01-dfac-4554-bffe-a046b079cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.749769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61b01-dfac-4554-bffe-a046b079cb8e None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.750976 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61b01-dfac-4554-bffe-a046b079cb8e None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:08.752726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61b01-dfac-4554-bffe-a046b079cb8e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:08.755025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 71/149] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:08 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:08.770430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:08.771833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61b01-dfac-4554-bffe-a046b079cb8e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.858996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2a598-a76d-4e48-8068-11ca9685d47e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:08.912333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399bb21-f97a-4226-8d1c-fa9b4859658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:08.912333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399bb21-f97a-4226-8d1c-fa9b4859658e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:08.912333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399bb21-f97a-4226-8d1c-fa9b4859658e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:08.912333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399bb21-f97a-4226-8d1c-fa9b4859658e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:08.920314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399bb21-f97a-4226-8d1c-fa9b4859658e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9399bb21-f97a-4226-8d1c-fa9b4859658e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:08.935559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:08.936502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:08.937260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:08.938606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 79/150] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:08.946519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399bb21-f97a-4226-8d1c-fa9b4859658e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:08.979989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61b01-dfac-4554-bffe-a046b079cb8e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:09.012684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:09.052762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823b92c-9041-45df-8c1b-39881f7f686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:09.053526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823b92c-9041-45df-8c1b-39881f7f686a None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:09.053753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823b92c-9041-45df-8c1b-39881f7f686a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:09.054030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823b92c-9041-45df-8c1b-39881f7f686a None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987/users/34f0d636c2604b9eb348539a21b6251f/roles/a38d1f35b6dc46adb69b7dc0ea4c9d36` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:09.056167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823b92c-9041-45df-8c1b-39881f7f686a None admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c72aa29764ef48849de4944696987, user_id=34f0d636c2604b9eb348539a21b6251f, role_id=a38d1f35b6dc46adb69b7dc0ea4c9d36)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:09.057845 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823b92c-9041-45df-8c1b-39881f7f686a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:09.081001 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399bb21-f97a-4226-8d1c-fa9b4859658e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:09.110651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:09.120102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:09.121080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:09.121553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:09.122043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:09.122981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:09.123486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:09.125237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:09.138649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 80/151] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:09.142260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:09.239747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 72/152] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:08 2022] PUT /identity/v3/projects/6a5c72aa29764ef48849de4944696987/users/34f0d636c2604b9eb348539a21b6251f/roles/a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:51:09.251043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a5d8-f696-4437-9866-7f54dd4025ad None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:09.294388 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c70455-7741-4c1e-9579-39a6c2f35137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:09.295678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70455-7741-4c1e-9579-39a6c2f35137 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:09.296155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70455-7741-4c1e-9579-39a6c2f35137 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:09.296760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70455-7741-4c1e-9579-39a6c2f35137 None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:09.298503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c70455-7741-4c1e-9579-39a6c2f35137 None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:09.302002 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c70455-7741-4c1e-9579-39a6c2f35137 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:09.302476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 81/153] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:09 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:09.313479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823b92c-9041-45df-8c1b-39881f7f686a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:09.464219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823b92c-9041-45df-8c1b-39881f7f686a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:09.517145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de21a-7509-489e-8e0a-0f83df8f47a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:09.518166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de21a-7509-489e-8e0a-0f83df8f47a7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:09.518751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de21a-7509-489e-8e0a-0f83df8f47a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:09.519250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de21a-7509-489e-8e0a-0f83df8f47a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:09.578140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:09.608141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de21a-7509-489e-8e0a-0f83df8f47a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:09.619230 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de21a-7509-489e-8e0a-0f83df8f47a7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:09.732917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 73/154] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:09.738915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c70455-7741-4c1e-9579-39a6c2f35137 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:09.849966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:09.896612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c70455-7741-4c1e-9579-39a6c2f35137 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:09.939035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0895fc-5493-48be-8ec8-4c2dfaa8992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:09.940274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0895fc-5493-48be-8ec8-4c2dfaa8992e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:09.941628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0895fc-5493-48be-8ec8-4c2dfaa8992e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:09.942105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0895fc-5493-48be-8ec8-4c2dfaa8992e None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:09.945801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0895fc-5493-48be-8ec8-4c2dfaa8992e None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:09.947550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0895fc-5493-48be-8ec8-4c2dfaa8992e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:09.949850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 82/155] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:09 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:09.955416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de21a-7509-489e-8e0a-0f83df8f47a7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:10.063876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:10.090879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de21a-7509-489e-8e0a-0f83df8f47a7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:10.131205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ace07-8f27-4ad2-aa33-5d4b84ff7c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:10.131863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ace07-8f27-4ad2-aa33-5d4b84ff7c4d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:10.132141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ace07-8f27-4ad2-aa33-5d4b84ff7c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:10.132436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ace07-8f27-4ad2-aa33-5d4b84ff7c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:10.133263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ace07-8f27-4ad2-aa33-5d4b84ff7c4d None admin] RBAC: Adding query filter params (role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=6a5c72aa29764ef48849de4944696987, user.id=dac67488793242039b05e7d68aa8f739) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:10.133569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ace07-8f27-4ad2-aa33-5d4b84ff7c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:10.135012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ace07-8f27-4ad2-aa33-5d4b84ff7c4d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:10.143269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 74/156] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:09 2022] GET /identity/v3/role_assignments?user.id=dac67488793242039b05e7d68aa8f739&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 610 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:10.595627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ffe5-8cd8-4696-a9f7-01bac35b8297 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:10.596173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ffe5-8cd8-4696-a9f7-01bac35b8297 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:10.596173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ffe5-8cd8-4696-a9f7-01bac35b8297 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:10.598316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 83/157] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:10.622138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815befa2-96b6-4abd-b528-04a4181ce702 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:10.622458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815befa2-96b6-4abd-b528-04a4181ce702 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:10.622689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815befa2-96b6-4abd-b528-04a4181ce702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:10.645354 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-815befa2-96b6-4abd-b528-04a4181ce702 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:10.646741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-815befa2-96b6-4abd-b528-04a4181ce702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:10.730826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 75/158] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:10.766584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505ffe5-8cd8-4696-a9f7-01bac35b8297 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:10.898325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505ffe5-8cd8-4696-a9f7-01bac35b8297 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:10.932282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:10.945945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66c7b6-e04e-46ac-b5b8-2cd40fd66b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:10.946911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c7b6-e04e-46ac-b5b8-2cd40fd66b49 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:10.947197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c7b6-e04e-46ac-b5b8-2cd40fd66b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:10.947476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c7b6-e04e-46ac-b5b8-2cd40fd66b49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:10.965172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66c7b6-e04e-46ac-b5b8-2cd40fd66b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-1c66c7b6-e04e-46ac-b5b8-2cd40fd66b49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:10.973436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:10.974344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:10.976558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 84/159] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:10.980401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815befa2-96b6-4abd-b528-04a4181ce702 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:11.075339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:11.108713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815befa2-96b6-4abd-b528-04a4181ce702 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:11.150014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:11.150613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:11.150895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:11.151173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:11.151925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:11.152233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:11.153723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:11.163348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 76/160] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:10 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:11.168843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66c7b6-e04e-46ac-b5b8-2cd40fd66b49 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:11.291223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66c7b6-e04e-46ac-b5b8-2cd40fd66b49 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:11.342878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d33fa-3dcc-4196-954a-3e431d82c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:11.343768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d33fa-3dcc-4196-954a-3e431d82c86e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:11.344049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d33fa-3dcc-4196-954a-3e431d82c86e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:11.344340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d33fa-3dcc-4196-954a-3e431d82c86e None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:11.345576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d33fa-3dcc-4196-954a-3e431d82c86e None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:11.347652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d33fa-3dcc-4196-954a-3e431d82c86e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:11.349344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 85/161] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:11 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:11.354771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:11.433904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5a8b-99c6-47fe-8c5b-00c24f59d36e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:11.434593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5a8b-99c6-47fe-8c5b-00c24f59d36e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:11.435373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5a8b-99c6-47fe-8c5b-00c24f59d36e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:11.436964 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 86/162] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:11 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:11.450286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304633d-7485-485e-b37d-39ccf55af190 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:11.451158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304633d-7485-485e-b37d-39ccf55af190 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:11.451656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304633d-7485-485e-b37d-39ccf55af190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:11.483522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b304633d-7485-485e-b37d-39ccf55af190 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:11.485105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b304633d-7485-485e-b37d-39ccf55af190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:11.520292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f8a0b-3905-4caa-954d-b5413fe3f96a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:11.573963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:11.603203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 87/163] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:11.617250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de5e33-3ba9-4b98-a20a-b80adfbf829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:11.617934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5e33-3ba9-4b98-a20a-b80adfbf829b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:11.618213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5e33-3ba9-4b98-a20a-b80adfbf829b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:11.618540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5e33-3ba9-4b98-a20a-b80adfbf829b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:11.629231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:11.646916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304633d-7485-485e-b37d-39ccf55af190 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:11.780093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304633d-7485-485e-b37d-39ccf55af190 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:11.807480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de5e33-3ba9-4b98-a20a-b80adfbf829b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:11.809620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de5e33-3ba9-4b98-a20a-b80adfbf829b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:11.850401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b2853-5506-41cb-8f45-47a3a1d0087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:11.851667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b2853-5506-41cb-8f45-47a3a1d0087d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:11.852143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b2853-5506-41cb-8f45-47a3a1d0087d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:11.852725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b2853-5506-41cb-8f45-47a3a1d0087d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:11.886269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b2853-5506-41cb-8f45-47a3a1d0087d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-789b2853-5506-41cb-8f45-47a3a1d0087d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:11.901773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:11.902705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:11.903465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:11.921358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 88/164] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:11.923023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd6620-8c6c-4149-929f-f520e0ead618 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:11.926366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd6620-8c6c-4149-929f-f520e0ead618 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:11.926878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd6620-8c6c-4149-929f-f520e0ead618 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:11.932561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 89/165] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:11 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:11.933632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd6620-8c6c-4149-929f-f520e0ead618 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:12.063782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:12.085850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 77/166] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:12.093187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b86ed-590d-473d-9066-780281c7540f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.093725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b86ed-590d-473d-9066-780281c7540f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.094199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b86ed-590d-473d-9066-780281c7540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.114077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6e4b86ed-590d-473d-9066-780281c7540f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:12.115882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6e4b86ed-590d-473d-9066-780281c7540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:12.148674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:12.195069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 78/167] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:12.198822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289f8d3-addf-4ce2-9f9e-b92e0e3f8957 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.200522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289f8d3-addf-4ce2-9f9e-b92e0e3f8957 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.201064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289f8d3-addf-4ce2-9f9e-b92e0e3f8957 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.203333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 79/168] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:12.206886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289f8d3-addf-4ce2-9f9e-b92e0e3f8957 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:12.211842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd6620-8c6c-4149-929f-f520e0ead618 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:12.257664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627648ff-ad3f-4886-84eb-7f7c165950c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:12.258674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627648ff-ad3f-4886-84eb-7f7c165950c9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.260060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627648ff-ad3f-4886-84eb-7f7c165950c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.260589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627648ff-ad3f-4886-84eb-7f7c165950c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.261620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627648ff-ad3f-4886-84eb-7f7c165950c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:12.263552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627648ff-ad3f-4886-84eb-7f7c165950c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:12.266213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627648ff-ad3f-4886-84eb-7f7c165950c9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:12.288400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 90/169] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:12.294245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38557041-9492-4c6a-9a8e-2cc3ce2dfc15 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.294777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38557041-9492-4c6a-9a8e-2cc3ce2dfc15 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.297287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38557041-9492-4c6a-9a8e-2cc3ce2dfc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.333723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-38557041-9492-4c6a-9a8e-2cc3ce2dfc15 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:12.335163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-38557041-9492-4c6a-9a8e-2cc3ce2dfc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:12.392991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289f8d3-addf-4ce2-9f9e-b92e0e3f8957 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:12.438279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 91/170] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:12.440268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38557041-9492-4c6a-9a8e-2cc3ce2dfc15 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:12.461463 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f14213-e94a-46fb-b3be-fd3b114e1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:12.462400 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14213-e94a-46fb-b3be-fd3b114e1b5b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.462687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14213-e94a-46fb-b3be-fd3b114e1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.462966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14213-e94a-46fb-b3be-fd3b114e1b5b None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.469164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f14213-e94a-46fb-b3be-fd3b114e1b5b None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:12.470684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f14213-e94a-46fb-b3be-fd3b114e1b5b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:12.472611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 80/171] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:12 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:12.473588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f14213-e94a-46fb-b3be-fd3b114e1b5b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:12.505746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:12.515178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:12.585658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38557041-9492-4c6a-9a8e-2cc3ce2dfc15 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:12.601747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f14213-e94a-46fb-b3be-fd3b114e1b5b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:12.629038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27ab5-015b-4817-a2d5-950d808552ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:12.630788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27ab5-015b-4817-a2d5-950d808552ef None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.631720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27ab5-015b-4817-a2d5-950d808552ef None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.632491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27ab5-015b-4817-a2d5-950d808552ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.639398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50fae-fc51-4597-a744-9f8c77bf0ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:12.640570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50fae-fc51-4597-a744-9f8c77bf0ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.640994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50fae-fc51-4597-a744-9f8c77bf0ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.641445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50fae-fc51-4597-a744-9f8c77bf0ed8 None admin] PATH_INFO: `/v3/users/a9572da5208c472b8724a85b89731b10` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.642799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e50fae-fc51-4597-a744-9f8c77bf0ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=a9572da5208c472b8724a85b89731b10)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:12.645391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e50fae-fc51-4597-a744-9f8c77bf0ed8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:12.646537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27ab5-015b-4817-a2d5-950d808552ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:12.652166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 81/172] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:12 2022] GET /identity/v3/users/a9572da5208c472b8724a85b89731b10 => generated 248 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:12.653394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50fae-fc51-4597-a744-9f8c77bf0ed8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-19d27ab5-015b-4817-a2d5-950d808552ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:12.654937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:12.655792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 92/173] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:12.657191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27ab5-015b-4817-a2d5-950d808552ef None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:12.775882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:12.781866 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:12.782277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27ab5-015b-4817-a2d5-950d808552ef None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:12.786262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50fae-fc51-4597-a744-9f8c77bf0ed8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:12.817993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7555ab-05eb-4fa2-88df-36f76abf0f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:12.819016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7555ab-05eb-4fa2-88df-36f76abf0f0e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.819528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7555ab-05eb-4fa2-88df-36f76abf0f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.820006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7555ab-05eb-4fa2-88df-36f76abf0f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.821252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7555ab-05eb-4fa2-88df-36f76abf0f0e None admin] RBAC: Adding query filter params (role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=6a5c72aa29764ef48849de4944696987, user.id=dac67488793242039b05e7d68aa8f739) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:12.821766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7555ab-05eb-4fa2-88df-36f76abf0f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:12.823434 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7555ab-05eb-4fa2-88df-36f76abf0f0e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:12.827680 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40951cb-0c95-455d-a2cf-30fb59903e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:12.828806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40951cb-0c95-455d-a2cf-30fb59903e82 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.829096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40951cb-0c95-455d-a2cf-30fb59903e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.829372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40951cb-0c95-455d-a2cf-30fb59903e82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.832545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 93/174] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:12 2022] GET /identity/v3/role_assignments?user.id=dac67488793242039b05e7d68aa8f739&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=6b666ed01b97482497ff1f656ecff898 => generated 610 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:12.834004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9170a4-c774-4065-bf0d-e0b4ce799ad3 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:12.834297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9170a4-c774-4065-bf0d-e0b4ce799ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:12.834630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9170a4-c774-4065-bf0d-e0b4ce799ad3 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:12.836004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 94/175] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:12.840385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9170a4-c774-4065-bf0d-e0b4ce799ad3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:12.853050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40951cb-0c95-455d-a2cf-30fb59903e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c40951cb-0c95-455d-a2cf-30fb59903e82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:12.864700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:12.865641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:12.866425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:12.869729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 82/176] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:51:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:12.871111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40951cb-0c95-455d-a2cf-30fb59903e82 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:12.966828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9170a4-c774-4065-bf0d-e0b4ce799ad3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.006140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40951cb-0c95-455d-a2cf-30fb59903e82 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.021701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f1bea-b4db-4894-b65d-320164d20519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.023050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f1bea-b4db-4894-b65d-320164d20519 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.024109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f1bea-b4db-4894-b65d-320164d20519 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.024774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f1bea-b4db-4894-b65d-320164d20519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.048338 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f93594-d379-45da-8343-9c67dccfb8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.049170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93594-d379-45da-8343-9c67dccfb8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.049526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93594-d379-45da-8343-9c67dccfb8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.050451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93594-d379-45da-8343-9c67dccfb8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.051507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93594-d379-45da-8343-9c67dccfb8d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:13.051896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93594-d379-45da-8343-9c67dccfb8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.053877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93594-d379-45da-8343-9c67dccfb8d3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:13.068827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:13.080652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 83/177] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:12 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:13.082746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96434-4deb-4e79-adf0-2b1722d34df0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.083167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96434-4deb-4e79-adf0-2b1722d34df0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.083732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96434-4deb-4e79-adf0-2b1722d34df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.113963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2ab96434-4deb-4e79-adf0-2b1722d34df0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:13.118610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2ab96434-4deb-4e79-adf0-2b1722d34df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:13.155650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:13.157284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f1bea-b4db-4894-b65d-320164d20519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.158970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f1bea-b4db-4894-b65d-320164d20519 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:13.221378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 84/178] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:13.222779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab96434-4deb-4e79-adf0-2b1722d34df0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:13.279153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 95/179] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:13.279929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f1bea-b4db-4894-b65d-320164d20519 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:13.341250 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:13.344297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab96434-4deb-4e79-adf0-2b1722d34df0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.378475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee8f2-0b97-489b-a92a-d7fd58ef6cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.379138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee8f2-0b97-489b-a92a-d7fd58ef6cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.379420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee8f2-0b97-489b-a92a-d7fd58ef6cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.379693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee8f2-0b97-489b-a92a-d7fd58ef6cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.380464 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee8f2-0b97-489b-a92a-d7fd58ef6cc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:13.380772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee8f2-0b97-489b-a92a-d7fd58ef6cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.381539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f1bea-b4db-4894-b65d-320164d20519 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.382158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee8f2-0b97-489b-a92a-d7fd58ef6cc8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:13.390266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 85/180] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:13.392172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fad9d-14b7-4283-9bd4-417a77277488 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.392487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fad9d-14b7-4283-9bd4-417a77277488 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.392770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fad9d-14b7-4283-9bd4-417a77277488 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.394245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 86/181] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:13.395369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da334e-80c0-4207-9b90-0034536045f1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.395653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da334e-80c0-4207-9b90-0034536045f1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.395922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da334e-80c0-4207-9b90-0034536045f1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.397254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 87/182] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:13.397845 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da334e-80c0-4207-9b90-0034536045f1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:13.414789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:13.419670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b23b-7271-4c65-a40f-4331b78111b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.420561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b23b-7271-4c65-a40f-4331b78111b7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.420838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b23b-7271-4c65-a40f-4331b78111b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.421113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b23b-7271-4c65-a40f-4331b78111b7 None admin] PATH_INFO: `/v3/users/dac67488793242039b05e7d68aa8f739` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.422292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b23b-7271-4c65-a40f-4331b78111b7 None admin] RBAC: Authorizing `identity:get_user(user_id=dac67488793242039b05e7d68aa8f739)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.423738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b23b-7271-4c65-a40f-4331b78111b7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:13.426093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 96/183] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:13 2022] GET /identity/v3/users/dac67488793242039b05e7d68aa8f739 => generated 276 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:13.426849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b23b-7271-4c65-a40f-4331b78111b7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:13.504283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da334e-80c0-4207-9b90-0034536045f1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.530809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b23b-7271-4c65-a40f-4331b78111b7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.537264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bd176-07bf-4d00-9ba0-bc792dd4a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.538047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd176-07bf-4d00-9ba0-bc792dd4a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.538329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd176-07bf-4d00-9ba0-bc792dd4a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.538601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd176-07bf-4d00-9ba0-bc792dd4a7a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.539752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627bd176-07bf-4d00-9ba0-bc792dd4a7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.541324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627bd176-07bf-4d00-9ba0-bc792dd4a7a8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:13.543630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 88/184] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:13.544769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bd176-07bf-4d00-9ba0-bc792dd4a7a8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:13.566722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:13.574581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7e607-e7ce-46e6-990c-49bd611809b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.575443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7e607-e7ce-46e6-990c-49bd611809b7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.575726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7e607-e7ce-46e6-990c-49bd611809b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.575996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7e607-e7ce-46e6-990c-49bd611809b7 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.577227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7e607-e7ce-46e6-990c-49bd611809b7 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.578660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7e607-e7ce-46e6-990c-49bd611809b7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:13.580377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 97/185] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:13 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:13.586060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d62a8b-af81-4bc2-86a5-5e7ca0634be5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.586345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d62a8b-af81-4bc2-86a5-5e7ca0634be5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.586625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d62a8b-af81-4bc2-86a5-5e7ca0634be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.604782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-05d62a8b-af81-4bc2-86a5-5e7ca0634be5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:13.606670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-05d62a8b-af81-4bc2-86a5-5e7ca0634be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:13.634605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:13.652690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bd176-07bf-4d00-9ba0-bc792dd4a7a8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.672471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 98/186] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:13.674685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654567c6-75a0-4384-87e6-86576965c626 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.674991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654567c6-75a0-4384-87e6-86576965c626 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.675342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654567c6-75a0-4384-87e6-86576965c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.691195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-654567c6-75a0-4384-87e6-86576965c626 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:13.692422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-654567c6-75a0-4384-87e6-86576965c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:13.697593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452af4e-6ec7-439d-896c-fedf32e8f49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.698457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452af4e-6ec7-439d-896c-fedf32e8f49a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.698732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452af4e-6ec7-439d-896c-fedf32e8f49a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.698998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452af4e-6ec7-439d-896c-fedf32e8f49a None admin] PATH_INFO: `/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.712889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452af4e-6ec7-439d-896c-fedf32e8f49a None admin] RBAC: Authorizing `identity:get_user(user_id=53cb75c90b0c4886ae2249fc39fd5dfa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.714350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452af4e-6ec7-439d-896c-fedf32e8f49a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:13.716041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 89/187] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:13 2022] GET /identity/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa => generated 284 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:13.716832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452af4e-6ec7-439d-896c-fedf32e8f49a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:13.761012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 99/188] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:13.761834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654567c6-75a0-4384-87e6-86576965c626 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:13.816895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452af4e-6ec7-439d-896c-fedf32e8f49a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.821707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:13.856128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fd328-9e19-42e2-ac95-15a20a43d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.856804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd328-9e19-42e2-ac95-15a20a43d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.857083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd328-9e19-42e2-ac95-15a20a43d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.857357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd328-9e19-42e2-ac95-15a20a43d5e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.866869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654567c6-75a0-4384-87e6-86576965c626 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:13.873678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:13.904943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaaee9-0f40-40e1-aceb-f23e2a062b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:13.905533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaaee9-0f40-40e1-aceb-f23e2a062b70 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:13.905816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaaee9-0f40-40e1-aceb-f23e2a062b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:13.906092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaaee9-0f40-40e1-aceb-f23e2a062b70 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:13.906793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaaee9-0f40-40e1-aceb-f23e2a062b70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.908237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaaee9-0f40-40e1-aceb-f23e2a062b70 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:13.933611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fd328-9e19-42e2-ac95-15a20a43d5e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:13.935088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fd328-9e19-42e2-ac95-15a20a43d5e3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:14.023073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 100/189] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:13 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:14.024009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaaee9-0f40-40e1-aceb-f23e2a062b70 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.040036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 90/190] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:14.040926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fd328-9e19-42e2-ac95-15a20a43d5e3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.087214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.152780 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fd328-9e19-42e2-ac95-15a20a43d5e3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.156702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaaee9-0f40-40e1-aceb-f23e2a062b70 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.174455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.192288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4827c-9dd5-4353-9480-b8efcd686098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.193121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4827c-9dd5-4353-9480-b8efcd686098 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.193536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4827c-9dd5-4353-9480-b8efcd686098 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.199040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4827c-9dd5-4353-9480-b8efcd686098 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.200904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.201890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.202307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.202745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.204059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=6a5c72aa29764ef48849de4944696987, user.id=a9572da5208c472b8724a85b89731b10) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:14.204595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:14.205823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4827c-9dd5-4353-9480-b8efcd686098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:14.207510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-bec4827c-9dd5-4353-9480-b8efcd686098 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:14.214614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:14.216054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:14.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 91/191] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:14.218423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 101/192] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/role_assignments?user.id=a9572da5208c472b8724a85b89731b10&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 610 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:14.218531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4827c-9dd5-4353-9480-b8efcd686098 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.218635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.370064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.373613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4827c-9dd5-4353-9480-b8efcd686098 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.383409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa433ae-5c00-4330-8841-0db833f3ad90 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.414619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a083-150e-4533-82fd-a39c437e7f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.415761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a083-150e-4533-82fd-a39c437e7f84 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.416796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a083-150e-4533-82fd-a39c437e7f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.417081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a083-150e-4533-82fd-a39c437e7f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.429473 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0a4b7-c5bb-4ac4-b070-0dea3bfd5e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.430298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0a4b7-c5bb-4ac4-b070-0dea3bfd5e77 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.430580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0a4b7-c5bb-4ac4-b070-0dea3bfd5e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.430855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0a4b7-c5bb-4ac4-b070-0dea3bfd5e77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.447329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0a4b7-c5bb-4ac4-b070-0dea3bfd5e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-65d0a4b7-c5bb-4ac4-b070-0dea3bfd5e77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:14.455667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:14.456917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:14.457679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:14.458256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 102/193] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:14.458797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0a4b7-c5bb-4ac4-b070-0dea3bfd5e77 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.506611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.509007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a083-150e-4533-82fd-a39c437e7f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:14.510506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a083-150e-4533-82fd-a39c437e7f84 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:14.593630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0a4b7-c5bb-4ac4-b070-0dea3bfd5e77 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.635004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.639354 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 92/194] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:14.640237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a083-150e-4533-82fd-a39c437e7f84 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.647029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7dcb-097b-4193-bb69-f87ac6ebe4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.660034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7dcb-097b-4193-bb69-f87ac6ebe4cc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.660034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7dcb-097b-4193-bb69-f87ac6ebe4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.660034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7dcb-097b-4193-bb69-f87ac6ebe4cc None admin] PATH_INFO: `/v3/projects/96ccd6f11ea24c06bca7f357b34f5961` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.660034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a7dcb-097b-4193-bb69-f87ac6ebe4cc None admin] RBAC: Authorizing `identity:get_project(project_id=96ccd6f11ea24c06bca7f357b34f5961)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:14.660034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a7dcb-097b-4193-bb69-f87ac6ebe4cc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:14.660034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 103/195] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/projects/96ccd6f11ea24c06bca7f357b34f5961 => generated 313 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:14.660578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7dcb-097b-4193-bb69-f87ac6ebe4cc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.745840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a083-150e-4533-82fd-a39c437e7f84 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.766119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7dcb-097b-4193-bb69-f87ac6ebe4cc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.768932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.782035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.782705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.782989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.783265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.784027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:14.784888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:14.791414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:14.795673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 93/196] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:14.796628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.806005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.806729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.807016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.807290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.808037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:14.808403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:14.809925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:14.821675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 104/197] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:14.822622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.862526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.904259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad901-1a8c-41e5-bb0d-a88007514044 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.933507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67493d-4b9b-43bd-b59d-a3a368729fbb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:14.939131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674499b-9079-4af4-9314-c1bb7cadc2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.939995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674499b-9079-4af4-9314-c1bb7cadc2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.940277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674499b-9079-4af4-9314-c1bb7cadc2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.941111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674499b-9079-4af4-9314-c1bb7cadc2c0 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.942443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674499b-9079-4af4-9314-c1bb7cadc2c0 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:14.943922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674499b-9079-4af4-9314-c1bb7cadc2c0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:14.945786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 94/198] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:14.946707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674499b-9079-4af4-9314-c1bb7cadc2c0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:14.981880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:14.982646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:14.982931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:14.983206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:14.984035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] RBAC: Adding query filter params (role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=96ccd6f11ea24c06bca7f357b34f5961, user.id=dac67488793242039b05e7d68aa8f739) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:14.984371 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:14.986051 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:14.994267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 105/199] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/role_assignments?user.id=dac67488793242039b05e7d68aa8f739&scope.project.id=96ccd6f11ea24c06bca7f357b34f5961&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 610 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:14.995202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:15.032558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:15.129461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0d0d-a005-4323-b856-798725dd1aac None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:15.179114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4cd7-5aae-4b66-9dd9-7e99f3d62f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:15.180967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4cd7-5aae-4b66-9dd9-7e99f3d62f13 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:15.181386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4cd7-5aae-4b66-9dd9-7e99f3d62f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:15.181669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4cd7-5aae-4b66-9dd9-7e99f3d62f13 None admin] PATH_INFO: `/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:15.186610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674499b-9079-4af4-9314-c1bb7cadc2c0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:15.188798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae4cd7-5aae-4b66-9dd9-7e99f3d62f13 None admin] RBAC: Authorizing `identity:get_user(user_id=53cb75c90b0c4886ae2249fc39fd5dfa)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:15.190284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae4cd7-5aae-4b66-9dd9-7e99f3d62f13 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:15.194837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 106/200] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa => generated 284 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:15.195491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4cd7-5aae-4b66-9dd9-7e99f3d62f13 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:15.247004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:15.256625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341941f-6251-4969-b20c-5668229c5c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:15.258029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341941f-6251-4969-b20c-5668229c5c9e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:15.259385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341941f-6251-4969-b20c-5668229c5c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:15.259850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341941f-6251-4969-b20c-5668229c5c9e None admin] PATH_INFO: `/v3/users/34f0d636c2604b9eb348539a21b6251f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:15.261279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341941f-6251-4969-b20c-5668229c5c9e None admin] RBAC: Authorizing `identity:get_user(user_id=34f0d636c2604b9eb348539a21b6251f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:15.267788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341941f-6251-4969-b20c-5668229c5c9e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:15.267788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 95/201] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:14 2022] GET /identity/v3/users/34f0d636c2604b9eb348539a21b6251f => generated 290 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:15.267788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341941f-6251-4969-b20c-5668229c5c9e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:15.339803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:15.344018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4cd7-5aae-4b66-9dd9-7e99f3d62f13 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:15.381410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:15.382025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:15.382305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:15.382574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:15.383469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=df2f90a9277341e6955ae06c4bf821b8, user.id=53cb75c90b0c4886ae2249fc39fd5dfa) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:15.383780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:15.385354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:15.392127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 107/202] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:15 2022] GET /identity/v3/role_assignments?user.id=53cb75c90b0c4886ae2249fc39fd5dfa&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:15.392911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:15.395282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341941f-6251-4969-b20c-5668229c5c9e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:15.437747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804b7e-cab7-49d0-a9f6-a36412210673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:15.438748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804b7e-cab7-49d0-a9f6-a36412210673 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:15.439178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804b7e-cab7-49d0-a9f6-a36412210673 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:15.439595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804b7e-cab7-49d0-a9f6-a36412210673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:15.506263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea2bcf-3b3f-49b0-bdf9-3b4a14b79263 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:15.519384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:15.524344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0804b7e-cab7-49d0-a9f6-a36412210673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:15.526214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0804b7e-cab7-49d0-a9f6-a36412210673 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:15.545389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751201f0-9125-4912-9327-c2a1b33ac7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:15.546042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751201f0-9125-4912-9327-c2a1b33ac7cb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:15.546323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751201f0-9125-4912-9327-c2a1b33ac7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:15.546594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751201f0-9125-4912-9327-c2a1b33ac7cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:15.582398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:15.624603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751201f0-9125-4912-9327-c2a1b33ac7cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:15.626151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751201f0-9125-4912-9327-c2a1b33ac7cb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:15.646221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 96/203] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:15 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:15.654476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804b7e-cab7-49d0-a9f6-a36412210673 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:15.765325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 108/204] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:15 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:15.771049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751201f0-9125-4912-9327-c2a1b33ac7cb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:15.785423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:15.790956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804b7e-cab7-49d0-a9f6-a36412210673 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:15.835835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707b783-d147-4d29-8233-6f73ee9fd147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:15.837244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707b783-d147-4d29-8233-6f73ee9fd147 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:15.838034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707b783-d147-4d29-8233-6f73ee9fd147 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:15.838771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707b783-d147-4d29-8233-6f73ee9fd147 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:15.840341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707b783-d147-4d29-8233-6f73ee9fd147 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:15.842454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707b783-d147-4d29-8233-6f73ee9fd147 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:15.843979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:15.845155 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 97/205] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:15 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:15.852040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707b783-d147-4d29-8233-6f73ee9fd147 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:15.920533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751201f0-9125-4912-9327-c2a1b33ac7cb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:15.968229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707b783-d147-4d29-8233-6f73ee9fd147 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:15.993794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf2217-edb2-49d2-bd6a-14e97ffa8289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:15.994669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2217-edb2-49d2-bd6a-14e97ffa8289 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:15.995038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2217-edb2-49d2-bd6a-14e97ffa8289 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:15.995208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf2217-edb2-49d2-bd6a-14e97ffa8289 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:16.001166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf2217-edb2-49d2-bd6a-14e97ffa8289 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:16.002933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf2217-edb2-49d2-bd6a-14e97ffa8289 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:16.004922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 109/206] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:15 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:16.009099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c8e0b-1361-4a77-bede-c8faf4261db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:16.010269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8e0b-1361-4a77-bede-c8faf4261db2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:16.010747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8e0b-1361-4a77-bede-c8faf4261db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:16.011028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf2217-edb2-49d2-bd6a-14e97ffa8289 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:16.011424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8e0b-1361-4a77-bede-c8faf4261db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:16.012568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c8e0b-1361-4a77-bede-c8faf4261db2 None admin] RBAC: Adding query filter params (role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=df2f90a9277341e6955ae06c4bf821b8, user.id=53cb75c90b0c4886ae2249fc39fd5dfa) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:16.013071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c8e0b-1361-4a77-bede-c8faf4261db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:16.014798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c8e0b-1361-4a77-bede-c8faf4261db2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:16.022781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 98/207] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:15 2022] GET /identity/v3/role_assignments?user.id=53cb75c90b0c4886ae2249fc39fd5dfa&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=6b666ed01b97482497ff1f656ecff898 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:16.209653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf2217-edb2-49d2-bd6a-14e97ffa8289 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:16.248998 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:16.256747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e15c-0a6e-43b8-89bb-cb30b17815dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:16.257409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e15c-0a6e-43b8-89bb-cb30b17815dc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:16.257696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e15c-0a6e-43b8-89bb-cb30b17815dc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:16.257953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e15c-0a6e-43b8-89bb-cb30b17815dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:16.258795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958e15c-0a6e-43b8-89bb-cb30b17815dc None admin] RBAC: Adding query filter params (role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36, scope.project.id=6a5c72aa29764ef48849de4944696987, user.id=34f0d636c2604b9eb348539a21b6251f) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:16.259106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958e15c-0a6e-43b8-89bb-cb30b17815dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:16.260566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958e15c-0a6e-43b8-89bb-cb30b17815dc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:16.267114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 110/208] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:16 2022] GET /identity/v3/role_assignments?user.id=34f0d636c2604b9eb348539a21b6251f&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 610 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:16.718559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522671-ed32-489d-85d8-b9911687d2ec None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:16.718559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522671-ed32-489d-85d8-b9911687d2ec None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:16.718559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522671-ed32-489d-85d8-b9911687d2ec None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:16.718559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 99/209] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:16.724039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be71c-a278-4568-9784-9cb06be30940 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:16.724342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be71c-a278-4568-9784-9cb06be30940 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:16.724627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138be71c-a278-4568-9784-9cb06be30940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:16.746186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-138be71c-a278-4568-9784-9cb06be30940 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:16.747384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-138be71c-a278-4568-9784-9cb06be30940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:16.834051 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 111/210] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:16.860528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522671-ed32-489d-85d8-b9911687d2ec None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:16.900348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:16.974863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53140-e400-41ec-a38f-11df07dab37d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:16.975405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53140-e400-41ec-a38f-11df07dab37d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:16.975689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53140-e400-41ec-a38f-11df07dab37d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:16.977517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 112/211] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:16.984594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522671-ed32-489d-85d8-b9911687d2ec None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:16.985053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391d44-de9a-4708-8172-b9d391a6066f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:16.985464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391d44-de9a-4708-8172-b9d391a6066f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:16.985844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391d44-de9a-4708-8172-b9d391a6066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:17.014215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-bf391d44-de9a-4708-8172-b9d391a6066f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:17.016246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bf391d44-de9a-4708-8172-b9d391a6066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:17.023909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34021f21-b2a0-40a9-bc56-d0ce1fdee63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:17.024935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021f21-b2a0-40a9-bc56-d0ce1fdee63f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:17.025384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021f21-b2a0-40a9-bc56-d0ce1fdee63f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:17.025793 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021f21-b2a0-40a9-bc56-d0ce1fdee63f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:17.037679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34021f21-b2a0-40a9-bc56-d0ce1fdee63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-34021f21-b2a0-40a9-bc56-d0ce1fdee63f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:17.045610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:17.051472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:17.052251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 100/212] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:17.054645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34021f21-b2a0-40a9-bc56-d0ce1fdee63f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:17.100049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 113/213] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:17.124684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf391d44-de9a-4708-8172-b9d391a6066f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:17.194566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.199046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.208121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34021f21-b2a0-40a9-bc56-d0ce1fdee63f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:17.250972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:17.251640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:17.251918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:17.256607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:17.256607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:17.256607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:17.256960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf391d44-de9a-4708-8172-b9d391a6066f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:17.257077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:17.266512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 101/214] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:17.273421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:17.317446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d1222-ea09-40e8-a739-fbd7d94df0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:17.319060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1222-ea09-40e8-a739-fbd7d94df0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:17.319521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1222-ea09-40e8-a739-fbd7d94df0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:17.319991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1222-ea09-40e8-a739-fbd7d94df0f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:17.321704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d1222-ea09-40e8-a739-fbd7d94df0f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:17.324154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d1222-ea09-40e8-a739-fbd7d94df0f7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:17.325993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 114/215] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:17.334331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d1222-ea09-40e8-a739-fbd7d94df0f7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:17.411703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90122ea0-53e0-44b9-8358-971973525c67 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:17.457370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d1222-ea09-40e8-a739-fbd7d94df0f7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:17.457960 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7391-641e-4a85-ab54-056a71cc8f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:17.458903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7391-641e-4a85-ab54-056a71cc8f9f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:17.459248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7391-641e-4a85-ab54-056a71cc8f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:17.459601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7391-641e-4a85-ab54-056a71cc8f9f None admin] PATH_INFO: `/v3/users/0b5a1520a6df4acf8f8fd88c7c458923` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:17.478330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b7391-641e-4a85-ab54-056a71cc8f9f None admin] RBAC: Authorizing `identity:get_user(user_id=0b5a1520a6df4acf8f8fd88c7c458923)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:17.479898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b7391-641e-4a85-ab54-056a71cc8f9f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:17.484365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 102/216] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:17 2022] GET /identity/v3/users/0b5a1520a6df4acf8f8fd88c7c458923 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:17.487940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.488386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7391-641e-4a85-ab54-056a71cc8f9f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:17.500884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc60a6-6715-4488-b205-3c6276d477da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:17.502812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc60a6-6715-4488-b205-3c6276d477da None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:17.502812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc60a6-6715-4488-b205-3c6276d477da None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:17.502812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc60a6-6715-4488-b205-3c6276d477da None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:17.503697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc60a6-6715-4488-b205-3c6276d477da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:17.505451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc60a6-6715-4488-b205-3c6276d477da None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:17.505856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.596760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7391-641e-4a85-ab54-056a71cc8f9f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:17.636346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 115/217] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:17 2022] POST /identity/v3/users => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:17.644150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a99-7950-4c9b-885f-58d9db76f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:17.644946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a99-7950-4c9b-885f-58d9db76f33e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:17.645239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a99-7950-4c9b-885f-58d9db76f33e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:17.645517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a99-7950-4c9b-885f-58d9db76f33e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:17.732670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6a99-7950-4c9b-885f-58d9db76f33e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:17.734974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6a99-7950-4c9b-885f-58d9db76f33e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:17.749270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.851436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 103/218] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:17.858469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc60a6-6715-4488-b205-3c6276d477da None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:17.982787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc60a6-6715-4488-b205-3c6276d477da None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:18.023590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac33339-228e-4cc4-8430-b757caff34a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:18.024491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac33339-228e-4cc4-8430-b757caff34a6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:18.024775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac33339-228e-4cc4-8430-b757caff34a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:18.025046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac33339-228e-4cc4-8430-b757caff34a6 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:18.026721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac33339-228e-4cc4-8430-b757caff34a6 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:18.028168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac33339-228e-4cc4-8430-b757caff34a6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:18.030194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 116/219] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:17 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:18.036202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a99-7950-4c9b-885f-58d9db76f33e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:18.213168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a99-7950-4c9b-885f-58d9db76f33e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:18.232412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:18.270234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577397e-21ce-4d09-9370-a575cbca14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:18.270944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577397e-21ce-4d09-9370-a575cbca14b6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:18.271250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577397e-21ce-4d09-9370-a575cbca14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:18.271610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577397e-21ce-4d09-9370-a575cbca14b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:18.272870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577397e-21ce-4d09-9370-a575cbca14b6 None admin] RBAC: Adding query filter params (role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=df2f90a9277341e6955ae06c4bf821b8, user.id=0b5a1520a6df4acf8f8fd88c7c458923) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:18.273261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577397e-21ce-4d09-9370-a575cbca14b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:18.274727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577397e-21ce-4d09-9370-a575cbca14b6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:18.278188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db01689-767d-4e4c-96e0-7e7d787f4cdf None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:18.278477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db01689-767d-4e4c-96e0-7e7d787f4cdf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:18.278800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db01689-767d-4e4c-96e0-7e7d787f4cdf None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:18.285134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 104/220] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:18 2022] GET /identity/v3/role_assignments?user.id=0b5a1520a6df4acf8f8fd88c7c458923&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:18.285899 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 117/221] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:18 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:18.303240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031957b2-f9b9-4e68-a066-678e6cc967b6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:18.303522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031957b2-f9b9-4e68-a066-678e6cc967b6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:18.303759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031957b2-f9b9-4e68-a066-678e6cc967b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:18.333288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-031957b2-f9b9-4e68-a066-678e6cc967b6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:18.334565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-031957b2-f9b9-4e68-a066-678e6cc967b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:18.442152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 105/222] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:18.482021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db01689-767d-4e4c-96e0-7e7d787f4cdf None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:18.546656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:18.573884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8ecc6-994e-460f-80a9-b7bcb9b20b51 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:18.574175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8ecc6-994e-460f-80a9-b7bcb9b20b51 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:18.574448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8ecc6-994e-460f-80a9-b7bcb9b20b51 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:18.575977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 106/223] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:51:18.582948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7324d-5de3-462c-8c3c-2200c03cba4f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:18.583265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7324d-5de3-462c-8c3c-2200c03cba4f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:18.583546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7324d-5de3-462c-8c3c-2200c03cba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:18.602628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3fc7324d-5de3-462c-8c3c-2200c03cba4f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:18.603805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3fc7324d-5de3-462c-8c3c-2200c03cba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:18.624990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db01689-767d-4e4c-96e0-7e7d787f4cdf None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:18.664494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f99b07-ded0-4c58-a891-34a8dd5c0b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:18.665297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f99b07-ded0-4c58-a891-34a8dd5c0b50 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:18.665669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f99b07-ded0-4c58-a891-34a8dd5c0b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:18.666039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f99b07-ded0-4c58-a891-34a8dd5c0b50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:18.678560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f99b07-ded0-4c58-a891-34a8dd5c0b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c1f99b07-ded0-4c58-a891-34a8dd5c0b50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:18.687066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:18.687936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:18.688745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:18.689344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 118/224] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:51:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:18.694977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f99b07-ded0-4c58-a891-34a8dd5c0b50 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:18.729910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 107/225] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:18.765325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7324d-5de3-462c-8c3c-2200c03cba4f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:18.820658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:18.890986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f99b07-ded0-4c58-a891-34a8dd5c0b50 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:18.907548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:18.930478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:18.931281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:18.931735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:18.932073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:18.932926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:18.933295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:18.936343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:18.949396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 119/226] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:18.950694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:18.951832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7324d-5de3-462c-8c3c-2200c03cba4f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:19.030770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d33bb-2fcb-4c3b-9dba-209529cbf6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:19.031846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d33bb-2fcb-4c3b-9dba-209529cbf6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:19.032266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d33bb-2fcb-4c3b-9dba-209529cbf6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:19.032695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d33bb-2fcb-4c3b-9dba-209529cbf6e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:19.057608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d33bb-2fcb-4c3b-9dba-209529cbf6e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-089d33bb-2fcb-4c3b-9dba-209529cbf6e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:19.070989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:19.075668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:19.076634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:19.079017 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 108/227] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:19.084364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317a6e-9e0d-4f52-92ea-140508d260c0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:19.088602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d33bb-2fcb-4c3b-9dba-209529cbf6e5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:19.120328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8133-3e81-47ab-95e2-48f99a67f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:19.120328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8133-3e81-47ab-95e2-48f99a67f094 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:19.120328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8133-3e81-47ab-95e2-48f99a67f094 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:19.120328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa8133-3e81-47ab-95e2-48f99a67f094 None admin] PATH_INFO: `/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:19.120908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa8133-3e81-47ab-95e2-48f99a67f094 None admin] RBAC: Authorizing `identity:get_user(user_id=53cb75c90b0c4886ae2249fc39fd5dfa)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:19.122228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa8133-3e81-47ab-95e2-48f99a67f094 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:19.128823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 120/228] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:18 2022] GET /identity/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa => generated 284 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:19.132060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8133-3e81-47ab-95e2-48f99a67f094 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:19.168253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:19.244331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa8133-3e81-47ab-95e2-48f99a67f094 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:19.271960 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:19.277961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ad2a0-bbd1-4773-bcae-d07619d717ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:19.278816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ad2a0-bbd1-4773-bcae-d07619d717ea None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:19.279113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ad2a0-bbd1-4773-bcae-d07619d717ea None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:19.279451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ad2a0-bbd1-4773-bcae-d07619d717ea None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:19.280678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ad2a0-bbd1-4773-bcae-d07619d717ea None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:19.285412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d33bb-2fcb-4c3b-9dba-209529cbf6e5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:19.285549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ad2a0-bbd1-4773-bcae-d07619d717ea None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:19.285549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 121/229] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:19 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:19.294216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ad2a0-bbd1-4773-bcae-d07619d717ea None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:19.319702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:19.321785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:19.322079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:19.322359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:19.323109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:19.323413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:19.324830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:19.347338 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 109/230] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:19 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:19.351589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:19.495755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ad2a0-bbd1-4773-bcae-d07619d717ea None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:19.500630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:19.537577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7f6c-8fb1-4564-bc82-8c2593f5c7b9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:19.568153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef21d7d-1de9-4d5f-b1a1-3e76966d4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:19.569472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21d7d-1de9-4d5f-b1a1-3e76966d4a98 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:19.569986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21d7d-1de9-4d5f-b1a1-3e76966d4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:19.570477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21d7d-1de9-4d5f-b1a1-3e76966d4a98 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8/users/53cb75c90b0c4886ae2249fc39fd5dfa/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:19.574801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef21d7d-1de9-4d5f-b1a1-3e76966d4a98 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2f90a9277341e6955ae06c4bf821b8, user_id=53cb75c90b0c4886ae2249fc39fd5dfa, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:19.576663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef21d7d-1de9-4d5f-b1a1-3e76966d4a98 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:19.595320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd148-ef7d-46fe-a32f-c21c708900c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:19.596968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd148-ef7d-46fe-a32f-c21c708900c8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:19.597581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd148-ef7d-46fe-a32f-c21c708900c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:19.598150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd148-ef7d-46fe-a32f-c21c708900c8 None admin] PATH_INFO: `/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:19.599666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dd148-ef7d-46fe-a32f-c21c708900c8 None admin] RBAC: Authorizing `identity:get_user(user_id=53cb75c90b0c4886ae2249fc39fd5dfa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:19.601442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dd148-ef7d-46fe-a32f-c21c708900c8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:19.603341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 110/231] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:19 2022] GET /identity/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa => generated 284 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:19.608764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd148-ef7d-46fe-a32f-c21c708900c8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:19.640779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:19.673557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 122/232] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:19 2022] PUT /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8/users/53cb75c90b0c4886ae2249fc39fd5dfa/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:19.730635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd148-ef7d-46fe-a32f-c21c708900c8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:19.781197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36a9d-640a-46f7-a44b-8c6db80dd67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:19.782079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36a9d-640a-46f7-a44b-8c6db80dd67f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:19.782360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36a9d-640a-46f7-a44b-8c6db80dd67f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:19.782634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36a9d-640a-46f7-a44b-8c6db80dd67f None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:19.783878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c36a9d-640a-46f7-a44b-8c6db80dd67f None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:19.785487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c36a9d-640a-46f7-a44b-8c6db80dd67f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:19.787297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 111/233] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:19 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:19.793447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef21d7d-1de9-4d5f-b1a1-3e76966d4a98 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:19.961687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef21d7d-1de9-4d5f-b1a1-3e76966d4a98 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:20.002814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e596fa1-ad29-4aee-aacb-a46522b32965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:20.003976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596fa1-ad29-4aee-aacb-a46522b32965 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:20.004366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596fa1-ad29-4aee-aacb-a46522b32965 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:20.004649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596fa1-ad29-4aee-aacb-a46522b32965 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8/users/53cb75c90b0c4886ae2249fc39fd5dfa/roles/6b666ed01b97482497ff1f656ecff898` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:20.007031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596fa1-ad29-4aee-aacb-a46522b32965 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2f90a9277341e6955ae06c4bf821b8, user_id=53cb75c90b0c4886ae2249fc39fd5dfa, role_id=6b666ed01b97482497ff1f656ecff898)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:20.008567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596fa1-ad29-4aee-aacb-a46522b32965 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:20.083305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 123/234] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:19 2022] PUT /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8/users/53cb75c90b0c4886ae2249fc39fd5dfa/roles/6b666ed01b97482497ff1f656ecff898 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:20.521422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af1881-4372-4fae-aa35-0cd444fd22f3 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:20.521712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af1881-4372-4fae-aa35-0cd444fd22f3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:20.521989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af1881-4372-4fae-aa35-0cd444fd22f3 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:20.523652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 112/235] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:20.529918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf4b9-3ee5-4803-80d2-452bf0451fc2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:20.530204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf4b9-3ee5-4803-80d2-452bf0451fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:20.530478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf4b9-3ee5-4803-80d2-452bf0451fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:20.549713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2afdf4b9-3ee5-4803-80d2-452bf0451fc2 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:20.551036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2afdf4b9-3ee5-4803-80d2-452bf0451fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:20.580867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:20.651288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 124/236] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:20.693041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4527-d1a2-407d-99f6-53e63e216651 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:20.693591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4527-d1a2-407d-99f6-53e63e216651 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:20.693827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b4527-d1a2-407d-99f6-53e63e216651 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:20.695373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 113/237] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:20.696289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf4b9-3ee5-4803-80d2-452bf0451fc2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:20.716580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27510-9d3e-4b41-817c-06e0cdf5d125 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:20.716856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27510-9d3e-4b41-817c-06e0cdf5d125 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:20.717121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27510-9d3e-4b41-817c-06e0cdf5d125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:20.739902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d6e27510-9d3e-4b41-817c-06e0cdf5d125 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:20.741104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d6e27510-9d3e-4b41-817c-06e0cdf5d125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:20.848702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf4b9-3ee5-4803-80d2-452bf0451fc2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:20.886425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd6727-addc-4e35-9fec-9b19e12f490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:20.887491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6727-addc-4e35-9fec-9b19e12f490a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:20.887914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6727-addc-4e35-9fec-9b19e12f490a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:20.888345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6727-addc-4e35-9fec-9b19e12f490a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:20.893687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd6727-addc-4e35-9fec-9b19e12f490a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:20.895826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd6727-addc-4e35-9fec-9b19e12f490a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:20.898460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 125/238] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:20.904612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd6727-addc-4e35-9fec-9b19e12f490a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:20.918089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 114/239] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:20.945107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:20.952824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e27510-9d3e-4b41-817c-06e0cdf5d125 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:20.998037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:21.062040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd6727-addc-4e35-9fec-9b19e12f490a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:21.084884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e27510-9d3e-4b41-817c-06e0cdf5d125 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:21.111440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace482ac-c2b1-498d-842b-f01d93cb214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:21.112031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace482ac-c2b1-498d-842b-f01d93cb214f None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.112326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace482ac-c2b1-498d-842b-f01d93cb214f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.113130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace482ac-c2b1-498d-842b-f01d93cb214f None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.113837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace482ac-c2b1-498d-842b-f01d93cb214f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:21.115273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace482ac-c2b1-498d-842b-f01d93cb214f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:21.124172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b69704-face-4f23-8727-37de68d7a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:21.125017 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b69704-face-4f23-8727-37de68d7a0bc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.125298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b69704-face-4f23-8727-37de68d7a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.125567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b69704-face-4f23-8727-37de68d7a0bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.139536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b69704-face-4f23-8727-37de68d7a0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-98b69704-face-4f23-8727-37de68d7a0bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:21.147734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:21.148786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:21.149590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 115/240] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:21.156360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fee197-4e58-4395-98cd-6ce4e896b404 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.156360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fee197-4e58-4395-98cd-6ce4e896b404 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.156360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fee197-4e58-4395-98cd-6ce4e896b404 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.157875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 116/241] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:21.157875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fee197-4e58-4395-98cd-6ce4e896b404 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:21.240332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 126/242] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:20 2022] POST /identity/v3/users => generated 294 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:21.242347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601e5e-a711-4aa7-9c7b-634d03e9169a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.242894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601e5e-a711-4aa7-9c7b-634d03e9169a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.243365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601e5e-a711-4aa7-9c7b-634d03e9169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.249200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:21.278412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fee197-4e58-4395-98cd-6ce4e896b404 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:21.280901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-11601e5e-a711-4aa7-9c7b-634d03e9169a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:21.282310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-11601e5e-a711-4aa7-9c7b-634d03e9169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:21.323063 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:21.323751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.324034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.324327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.328334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:21.328334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:21.329396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:21.339605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 117/243] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:21 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:21.347253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:21.469234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7dc42-5dd0-4fad-9553-f97fe51b7655 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:21.495987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 127/244] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:21.510075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e85b-5dc3-4ce5-9c0e-2b1f715cfab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:21.510075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e85b-5dc3-4ce5-9c0e-2b1f715cfab0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.510075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e85b-5dc3-4ce5-9c0e-2b1f715cfab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.510362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e85b-5dc3-4ce5-9c0e-2b1f715cfab0 None admin] PATH_INFO: `/v3/users/0edbdb124ad646b59f0323856bbc92e9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.520725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601e5e-a711-4aa7-9c7b-634d03e9169a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:21.525446 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1e85b-5dc3-4ce5-9c0e-2b1f715cfab0 None admin] RBAC: Authorizing `identity:get_user(user_id=0edbdb124ad646b59f0323856bbc92e9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:21.526953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1e85b-5dc3-4ce5-9c0e-2b1f715cfab0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:21.528708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 118/245] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:21 2022] GET /identity/v3/users/0edbdb124ad646b59f0323856bbc92e9 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:21.534000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e85b-5dc3-4ce5-9c0e-2b1f715cfab0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:21.535877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:21.584849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:21.641491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11601e5e-a711-4aa7-9c7b-634d03e9169a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:21.642478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e85b-5dc3-4ce5-9c0e-2b1f715cfab0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:21.678917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08018-6a50-4e74-a420-43653a6d82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:21.679573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08018-6a50-4e74-a420-43653a6d82ad None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.679857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08018-6a50-4e74-a420-43653a6d82ad None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.679977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc6d8e-2421-4078-b278-516cf0d49f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:21.680128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08018-6a50-4e74-a420-43653a6d82ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.680909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6d8e-2421-4078-b278-516cf0d49f02 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.681392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6d8e-2421-4078-b278-516cf0d49f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.681730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6d8e-2421-4078-b278-516cf0d49f02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.699808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc6d8e-2421-4078-b278-516cf0d49f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-53dc6d8e-2421-4078-b278-516cf0d49f02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:21.710676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:21.711549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:21.712319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:21.712929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 128/246] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:21.722298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc6d8e-2421-4078-b278-516cf0d49f02 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:21.769803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e08018-6a50-4e74-a420-43653a6d82ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:21.771432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e08018-6a50-4e74-a420-43653a6d82ad None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:21.773430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:21.810718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:21.854997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc6d8e-2421-4078-b278-516cf0d49f02 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:21.902132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 119/247] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:51:21.903081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:21.903756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:21.904040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:21.904333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:21.905098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:21.905406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:21.906797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:21.907543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08018-6a50-4e74-a420-43653a6d82ad None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:21.918425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 129/248] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:21 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:21.924370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:22.017688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08018-6a50-4e74-a420-43653a6d82ad None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:22.019634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:22.034111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e82bd-5833-4c76-8068-f9f1993837c7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:22.053770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43016849-1d64-4c2b-be99-f27878f479e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:22.054687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43016849-1d64-4c2b-be99-f27878f479e9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.054972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43016849-1d64-4c2b-be99-f27878f479e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.055317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43016849-1d64-4c2b-be99-f27878f479e9 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.056561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43016849-1d64-4c2b-be99-f27878f479e9 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:22.058026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43016849-1d64-4c2b-be99-f27878f479e9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:22.059755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 120/249] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:21 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:22.065109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:22.066394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43016849-1d64-4c2b-be99-f27878f479e9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:22.071984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878771-5da4-4410-8f98-bba5d0aa01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:22.072952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878771-5da4-4410-8f98-bba5d0aa01bd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.073233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878771-5da4-4410-8f98-bba5d0aa01bd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.073514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878771-5da4-4410-8f98-bba5d0aa01bd None admin] PATH_INFO: `/v3/users/0b5a1520a6df4acf8f8fd88c7c458923` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.075331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8878771-5da4-4410-8f98-bba5d0aa01bd None admin] RBAC: Authorizing `identity:get_user(user_id=0b5a1520a6df4acf8f8fd88c7c458923)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:22.077092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8878771-5da4-4410-8f98-bba5d0aa01bd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:22.078859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 130/250] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:21 2022] GET /identity/v3/users/0b5a1520a6df4acf8f8fd88c7c458923 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:22.084891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878771-5da4-4410-8f98-bba5d0aa01bd None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:22.173847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43016849-1d64-4c2b-be99-f27878f479e9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:22.197029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878771-5da4-4410-8f98-bba5d0aa01bd None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:22.213336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:22.214103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.214387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.214664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.215515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] RBAC: Adding query filter params (role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36, scope.project.id=df2f90a9277341e6955ae06c4bf821b8, user.id=0edbdb124ad646b59f0323856bbc92e9) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:22.215829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:22.217352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:22.225787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 121/251] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:22 2022] GET /identity/v3/role_assignments?user.id=0edbdb124ad646b59f0323856bbc92e9&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:22.239139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa09aa-7c76-471a-ab9e-66fadaaf313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:22.240097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa09aa-7c76-471a-ab9e-66fadaaf313f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.240415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa09aa-7c76-471a-ab9e-66fadaaf313f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.240696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa09aa-7c76-471a-ab9e-66fadaaf313f None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.242073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa09aa-7c76-471a-ab9e-66fadaaf313f None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:22.243650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa09aa-7c76-471a-ab9e-66fadaaf313f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:22.245818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 131/252] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:22 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:22.251929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:22.308878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:22.383575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8436d-5ddc-434e-99a5-8a591dd7fd1c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:22.425042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367bc7c-6083-410b-9fa3-1d9507a4abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:22.425962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367bc7c-6083-410b-9fa3-1d9507a4abd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.426248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367bc7c-6083-410b-9fa3-1d9507a4abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.426528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367bc7c-6083-410b-9fa3-1d9507a4abd4 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8/users/0b5a1520a6df4acf8f8fd88c7c458923/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.429756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367bc7c-6083-410b-9fa3-1d9507a4abd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2f90a9277341e6955ae06c4bf821b8, user_id=0b5a1520a6df4acf8f8fd88c7c458923, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:22.431350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367bc7c-6083-410b-9fa3-1d9507a4abd4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:22.431896 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9718-8184-4239-9844-5d0b5e9dc1ac None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.432190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9718-8184-4239-9844-5d0b5e9dc1ac None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.432505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9718-8184-4239-9844-5d0b5e9dc1ac None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.434100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 132/253] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:22.439861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8075ac1-4192-4e12-b4a5-a2013f29fdbb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.440140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8075ac1-4192-4e12-b4a5-a2013f29fdbb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.440453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8075ac1-4192-4e12-b4a5-a2013f29fdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.459698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f8075ac1-4192-4e12-b4a5-a2013f29fdbb None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:22.460939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f8075ac1-4192-4e12-b4a5-a2013f29fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:22.543722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 122/254] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:22 2022] PUT /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8/users/0b5a1520a6df4acf8f8fd88c7c458923/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:22.554749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:22.564274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 133/255] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:22.590781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367bc7c-6083-410b-9fa3-1d9507a4abd4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:22.716245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:22.724334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367bc7c-6083-410b-9fa3-1d9507a4abd4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:22.778093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc6d2-f07c-40dc-afa9-b2d4de0d8532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:22.778909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc6d2-f07c-40dc-afa9-b2d4de0d8532 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.779194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc6d2-f07c-40dc-afa9-b2d4de0d8532 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.779471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc6d2-f07c-40dc-afa9-b2d4de0d8532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.797307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fc6d2-f07c-40dc-afa9-b2d4de0d8532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-cc0fc6d2-f07c-40dc-afa9-b2d4de0d8532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:22.806879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:22.807770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:22.808572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 123/256] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:51:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:22.814353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8075ac1-4192-4e12-b4a5-a2013f29fdbb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:22.923214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8075ac1-4192-4e12-b4a5-a2013f29fdbb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:22.962372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:22.963061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:22.963342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:22.963620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:22.964411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:22.964861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:22.966287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:22.977290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 134/257] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:22.983046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc6d2-f07c-40dc-afa9-b2d4de0d8532 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:23.104286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc6d2-f07c-40dc-afa9-b2d4de0d8532 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:23.151370 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8f885-be13-4250-8894-ef2e6803c74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:23.152243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f885-be13-4250-8894-ef2e6803c74c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:23.152546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f885-be13-4250-8894-ef2e6803c74c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:23.152822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f885-be13-4250-8894-ef2e6803c74c None admin] PATH_INFO: `/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:23.157024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8f885-be13-4250-8894-ef2e6803c74c None admin] RBAC: Authorizing `identity:get_user(user_id=53cb75c90b0c4886ae2249fc39fd5dfa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:23.158577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8f885-be13-4250-8894-ef2e6803c74c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:23.160629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 124/258] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:22 2022] GET /identity/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa => generated 284 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:23.166225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:23.195467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9db67e-2330-4512-8e8a-e23d274abd03 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:23.195791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9db67e-2330-4512-8e8a-e23d274abd03 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:23.196015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9db67e-2330-4512-8e8a-e23d274abd03 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:23.197720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 125/259] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:51:23.202877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e3332-0fae-4cfe-b65b-c3da1842a34b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:23.203170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e3332-0fae-4cfe-b65b-c3da1842a34b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:23.203444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e3332-0fae-4cfe-b65b-c3da1842a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:23.220667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-362e3332-0fae-4cfe-b65b-c3da1842a34b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:23.221904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-362e3332-0fae-4cfe-b65b-c3da1842a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:23.235554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:23.245352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:23.328642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41588faa-3875-440c-8739-edc50a457a4c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:23.358039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 126/260] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:23.380868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84a8c2-6ca7-49ad-9dad-77d1845ade02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:23.381838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a8c2-6ca7-49ad-9dad-77d1845ade02 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:23.382331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a8c2-6ca7-49ad-9dad-77d1845ade02 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:23.382819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84a8c2-6ca7-49ad-9dad-77d1845ade02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:23.417357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e3332-0fae-4cfe-b65b-c3da1842a34b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:23.470045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84a8c2-6ca7-49ad-9dad-77d1845ade02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:23.471959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84a8c2-6ca7-49ad-9dad-77d1845ade02 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:23.536737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:23.584961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 135/261] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:23.591296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84a8c2-6ca7-49ad-9dad-77d1845ade02 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:23.729068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e3332-0fae-4cfe-b65b-c3da1842a34b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:23.765405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031162eb-cabd-42c7-af67-11e012626b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:23.766216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031162eb-cabd-42c7-af67-11e012626b9a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:23.766499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031162eb-cabd-42c7-af67-11e012626b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:23.766766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031162eb-cabd-42c7-af67-11e012626b9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:23.777049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031162eb-cabd-42c7-af67-11e012626b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-031162eb-cabd-42c7-af67-11e012626b9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:23.785912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:23.786826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:23.787601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 127/262] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:23.792836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031162eb-cabd-42c7-af67-11e012626b9a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:23.824493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:23.836765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84a8c2-6ca7-49ad-9dad-77d1845ade02 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:23.941070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57724f-b789-458d-8924-7fe8bbe4eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:23.941955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57724f-b789-458d-8924-7fe8bbe4eb5c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:23.942242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57724f-b789-458d-8924-7fe8bbe4eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:23.942523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57724f-b789-458d-8924-7fe8bbe4eb5c None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:23.943766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57724f-b789-458d-8924-7fe8bbe4eb5c None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:23.945335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57724f-b789-458d-8924-7fe8bbe4eb5c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:23.947280 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 136/263] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:23 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:23.953206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57724f-b789-458d-8924-7fe8bbe4eb5c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:23.990556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031162eb-cabd-42c7-af67-11e012626b9a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:24.015517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:24.083837 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:24.084541 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:24.084835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:24.085119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:24.085835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:24.086140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:24.087672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:24.110530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 128/264] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:24.116233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:24.133533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57724f-b789-458d-8924-7fe8bbe4eb5c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:24.195938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:24.197427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:24.198111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:24.198594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:24.199652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=df2f90a9277341e6955ae06c4bf821b8, user.id=53cb75c90b0c4886ae2249fc39fd5dfa) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:24.200177 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:24.201871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:24.214144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 137/265] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:23 2022] GET /identity/v3/role_assignments?user.id=53cb75c90b0c4886ae2249fc39fd5dfa&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 610 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:24.293362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:24.321375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981703d9-406d-4d21-ba3d-fbe9c8e8f883 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:24.357723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bae48-204c-4857-93ac-336e8767714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:24.358611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bae48-204c-4857-93ac-336e8767714e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:24.358894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bae48-204c-4857-93ac-336e8767714e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:24.359179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bae48-204c-4857-93ac-336e8767714e None admin] PATH_INFO: `/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:24.360469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bae48-204c-4857-93ac-336e8767714e None admin] RBAC: Authorizing `identity:get_user(user_id=53cb75c90b0c4886ae2249fc39fd5dfa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:24.361955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bae48-204c-4857-93ac-336e8767714e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:24.364711 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 129/266] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:24 2022] GET /identity/v3/users/53cb75c90b0c4886ae2249fc39fd5dfa => generated 284 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:24.369776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:24.536330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:24.542719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac588794-9291-4773-a244-f072f4896f95 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:24.590165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfb3b7-6fd6-4ad7-8669-8bb85d20b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:24.591198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb3b7-6fd6-4ad7-8669-8bb85d20b095 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:24.591704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb3b7-6fd6-4ad7-8669-8bb85d20b095 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:24.592182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb3b7-6fd6-4ad7-8669-8bb85d20b095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:24.670018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfb3b7-6fd6-4ad7-8669-8bb85d20b095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:24.671518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfb3b7-6fd6-4ad7-8669-8bb85d20b095 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:24.769682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:24.782650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 138/267] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:24.789239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bae48-204c-4857-93ac-336e8767714e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:24.916295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bae48-204c-4857-93ac-336e8767714e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:24.955766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5b4e8-6915-45e9-8f27-b0d0cc8c755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:24.957207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b4e8-6915-45e9-8f27-b0d0cc8c755a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:24.957493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b4e8-6915-45e9-8f27-b0d0cc8c755a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:24.957758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b4e8-6915-45e9-8f27-b0d0cc8c755a None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:24.958992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5b4e8-6915-45e9-8f27-b0d0cc8c755a None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:24.960485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5b4e8-6915-45e9-8f27-b0d0cc8c755a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:24.962193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 130/268] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:24 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:24.968060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfb3b7-6fd6-4ad7-8669-8bb85d20b095 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:25.073111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d8ba-32fa-4041-903e-a68c82727177 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.073440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d8ba-32fa-4041-903e-a68c82727177 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.073675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d8ba-32fa-4041-903e-a68c82727177 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.075194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 131/269] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:51:25.080497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd3af-f6d5-4de9-858a-17d4eb675274 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.082647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd3af-f6d5-4de9-858a-17d4eb675274 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.082647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dd3af-f6d5-4de9-858a-17d4eb675274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.102003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0d1dd3af-f6d5-4de9-858a-17d4eb675274 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:25.103044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfb3b7-6fd6-4ad7-8669-8bb85d20b095 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:25.103558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0d1dd3af-f6d5-4de9-858a-17d4eb675274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:25.107659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:25.150685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b4c03-074d-47c6-be14-c5a3a772b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:25.151340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b4c03-074d-47c6-be14-c5a3a772b7bf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.151619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b4c03-074d-47c6-be14-c5a3a772b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.151891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b4c03-074d-47c6-be14-c5a3a772b7bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.153190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b4c03-074d-47c6-be14-c5a3a772b7bf None admin] RBAC: Adding query filter params (role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=df2f90a9277341e6955ae06c4bf821b8, user.id=53cb75c90b0c4886ae2249fc39fd5dfa) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:25.153504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b4c03-074d-47c6-be14-c5a3a772b7bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:25.154952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b4c03-074d-47c6-be14-c5a3a772b7bf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:25.168496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 139/270] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:24 2022] GET /identity/v3/role_assignments?user.id=53cb75c90b0c4886ae2249fc39fd5dfa&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=6b666ed01b97482497ff1f656ecff898 => generated 610 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:25.168496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafdcb-61a6-494b-b23e-fc364782d668 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.168496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafdcb-61a6-494b-b23e-fc364782d668 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.168496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafdcb-61a6-494b-b23e-fc364782d668 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.168496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 140/271] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:25.174685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79116b-8a0c-4037-8523-34629b844bb0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.175523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79116b-8a0c-4037-8523-34629b844bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.175788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79116b-8a0c-4037-8523-34629b844bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.195779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-da79116b-8a0c-4037-8523-34629b844bb0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:25.197053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-da79116b-8a0c-4037-8523-34629b844bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:25.241724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 132/272] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:25.263861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:25.283548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dd3af-f6d5-4de9-858a-17d4eb675274 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:25.292718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 141/273] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:25.311893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79116b-8a0c-4037-8523-34629b844bb0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:25.431489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79116b-8a0c-4037-8523-34629b844bb0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:25.479480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e02fdd-d54c-4927-b459-26f5ebf682d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:25.480482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02fdd-d54c-4927-b459-26f5ebf682d2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.480868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02fdd-d54c-4927-b459-26f5ebf682d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.481312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02fdd-d54c-4927-b459-26f5ebf682d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.494413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dd3af-f6d5-4de9-858a-17d4eb675274 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:25.494916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e02fdd-d54c-4927-b459-26f5ebf682d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a5e02fdd-d54c-4927-b459-26f5ebf682d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:25.509747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:25.510682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:25.511470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:25.512129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 142/274] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:25.517468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e02fdd-d54c-4927-b459-26f5ebf682d2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:25.544576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d3373-9bf9-4e0b-8b68-a4c641c3bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:25.545372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3373-9bf9-4e0b-8b68-a4c641c3bb08 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.545649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3373-9bf9-4e0b-8b68-a4c641c3bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.548921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3373-9bf9-4e0b-8b68-a4c641c3bb08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.551943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d3373-9bf9-4e0b-8b68-a4c641c3bb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:25.552661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d3373-9bf9-4e0b-8b68-a4c641c3bb08 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:25.554628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 133/275] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:25 2022] GET /identity/v3/domains/default => generated 200 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:25.559803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d3373-9bf9-4e0b-8b68-a4c641c3bb08 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:25.573985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:25.578061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:25.638658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e02fdd-d54c-4927-b459-26f5ebf682d2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:25.671594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d3373-9bf9-4e0b-8b68-a4c641c3bb08 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:25.677305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:25.678124 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.678472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.678817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.679644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:25.680010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:25.681569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:25.697586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 143/276] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:25.698922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:25.719811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062a8e5-a3b8-494d-964a-a79b87edd0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:25.721702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062a8e5-a3b8-494d-964a-a79b87edd0be None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.723148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062a8e5-a3b8-494d-964a-a79b87edd0be None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.723758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062a8e5-a3b8-494d-964a-a79b87edd0be None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.724638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062a8e5-a3b8-494d-964a-a79b87edd0be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:25.726872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062a8e5-a3b8-494d-964a-a79b87edd0be None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:25.820911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc77272-8f75-4db8-84ef-3dc9360cbdf7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:25.828468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:25.838934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 134/277] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:25 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:25.865968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd38c8-bfa8-4e2a-acf9-1e6b1bb330ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:25.866989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd38c8-bfa8-4e2a-acf9-1e6b1bb330ba None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.867277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd38c8-bfa8-4e2a-acf9-1e6b1bb330ba None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.867553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd38c8-bfa8-4e2a-acf9-1e6b1bb330ba None admin] PATH_INFO: `/v3/users/c60c5a2bb6314fb3af27d72a1bab81c8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.885023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd38c8-bfa8-4e2a-acf9-1e6b1bb330ba None admin] RBAC: Authorizing `identity:get_user(user_id=c60c5a2bb6314fb3af27d72a1bab81c8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:25.886571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd38c8-bfa8-4e2a-acf9-1e6b1bb330ba None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:25.888416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 144/278] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:25 2022] GET /identity/v3/users/c60c5a2bb6314fb3af27d72a1bab81c8 => generated 294 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:25.895190 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062a8e5-a3b8-494d-964a-a79b87edd0be None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:25.929652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd88a-2e9c-46fa-9ca3-725704033e09 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.929953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd88a-2e9c-46fa-9ca3-725704033e09 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.930371 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd88a-2e9c-46fa-9ca3-725704033e09 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.932433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 145/279] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:25.938979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9857f-3b90-4667-b619-a7b4b026a656 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:25.939352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9857f-3b90-4667-b619-a7b4b026a656 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:25.939918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9857f-3b90-4667-b619-a7b4b026a656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:25.963069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-31d9857f-3b90-4667-b619-a7b4b026a656 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:25.964776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-31d9857f-3b90-4667-b619-a7b4b026a656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:25.992690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:26.021636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062a8e5-a3b8-494d-964a-a79b87edd0be None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:26.054262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 146/280] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:26.055692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842eb6-2a8f-4679-90bb-eabf451c34bf None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:26.055926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842eb6-2a8f-4679-90bb-eabf451c34bf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:26.056437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842eb6-2a8f-4679-90bb-eabf451c34bf None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:26.058003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 147/281] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:26.063341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b860758-d403-4a4a-a90e-899356144bcc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:26.063630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b860758-d403-4a4a-a90e-899356144bcc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:26.063908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b860758-d403-4a4a-a90e-899356144bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:26.084756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7b860758-d403-4a4a-a90e-899356144bcc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:26.085062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:26.085743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:26.087185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7b860758-d403-4a4a-a90e-899356144bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:26.087291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:26.087291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:26.087430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] RBAC: Adding query filter params (role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, user.id=c60c5a2bb6314fb3af27d72a1bab81c8, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:26.087758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:26.089237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:26.095041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 135/282] 10.222.0.123 () {56 vars in 1313 bytes} [Thu May 26 17:51:25 2022] GET /identity/v3/role_assignments?user.id=c60c5a2bb6314fb3af27d72a1bab81c8&scope.system=all&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 227 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:26.095904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:26.223792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 148/283] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:26.250344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b860758-d403-4a4a-a90e-899356144bcc None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:26.294255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:26.311917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27244f-d6d3-4edd-9d23-c4a420f85d9f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:26.355056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:26.360275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac3f8-b1c4-4b53-8520-214e81bd9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:26.361098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac3f8-b1c4-4b53-8520-214e81bd9754 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:26.366433 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac3f8-b1c4-4b53-8520-214e81bd9754 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:26.366433 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac3f8-b1c4-4b53-8520-214e81bd9754 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:26.380297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ac3f8-b1c4-4b53-8520-214e81bd9754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ec4ac3f8-b1c4-4b53-8520-214e81bd9754 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:26.389488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:26.390431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:26.391210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 136/284] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:26.397840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac3f8-b1c4-4b53-8520-214e81bd9754 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:26.436139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b860758-d403-4a4a-a90e-899356144bcc None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:26.523363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2baecc-6cc6-4fa4-bd82-dce4d9e392cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:26.524171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2baecc-6cc6-4fa4-bd82-dce4d9e392cf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:26.524472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2baecc-6cc6-4fa4-bd82-dce4d9e392cf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:26.524742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2baecc-6cc6-4fa4-bd82-dce4d9e392cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:26.551811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2baecc-6cc6-4fa4-bd82-dce4d9e392cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-1a2baecc-6cc6-4fa4-bd82-dce4d9e392cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:26.567789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:26.568889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:26.569695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:26.574391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 149/285] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:26.581492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2baecc-6cc6-4fa4-bd82-dce4d9e392cf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:26.686494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac3f8-b1c4-4b53-8520-214e81bd9754 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:26.691351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:26.718423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2baecc-6cc6-4fa4-bd82-dce4d9e392cf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:26.743669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:26.744620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:26.745047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:26.745491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:26.746383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:26.746833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:26.748401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:26.767194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:26.767860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:26.768136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:26.768448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:26.769258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:26.769565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:26.771148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:26.773249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 137/286] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:26 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:26.780473 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 150/287] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:26.781525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:26.786802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:26.875100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:26.950265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79520ebf-75bc-4f0d-bffd-b53eaee42a2f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:26.978084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771ab6f-61ec-45d7-af3b-77beec2e03b5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:27.019509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f78b17-42dd-435a-ae40-cae52367714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:27.021086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f78b17-42dd-435a-ae40-cae52367714f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:27.021558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f78b17-42dd-435a-ae40-cae52367714f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:27.022163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f78b17-42dd-435a-ae40-cae52367714f None admin] PATH_INFO: `/v3/users/0edbdb124ad646b59f0323856bbc92e9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:27.023641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f78b17-42dd-435a-ae40-cae52367714f None admin] RBAC: Authorizing `identity:get_user(user_id=0edbdb124ad646b59f0323856bbc92e9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:27.025332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f78b17-42dd-435a-ae40-cae52367714f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:27.027534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 138/288] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:26 2022] GET /identity/v3/users/0edbdb124ad646b59f0323856bbc92e9 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:27.029035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b432-2c77-4663-af07-3e063bc95e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:27.030162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b432-2c77-4663-af07-3e063bc95e3c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:27.030701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b432-2c77-4663-af07-3e063bc95e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:27.031163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b432-2c77-4663-af07-3e063bc95e3c None admin] PATH_INFO: `/v3/users/0b5a1520a6df4acf8f8fd88c7c458923` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:27.032840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f78b17-42dd-435a-ae40-cae52367714f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:27.034031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786b432-2c77-4663-af07-3e063bc95e3c None admin] RBAC: Authorizing `identity:get_user(user_id=0b5a1520a6df4acf8f8fd88c7c458923)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:27.038432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786b432-2c77-4663-af07-3e063bc95e3c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:27.046648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 151/289] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:26 2022] GET /identity/v3/users/0b5a1520a6df4acf8f8fd88c7c458923 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:27.052683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b432-2c77-4663-af07-3e063bc95e3c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:27.081199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:27.226083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b432-2c77-4663-af07-3e063bc95e3c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:27.233205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f78b17-42dd-435a-ae40-cae52367714f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:27.250780 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:27.269740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ae1c0-155e-4b67-a762-ee3c4a7529a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:27.271007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ae1c0-155e-4b67-a762-ee3c4a7529a1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:27.271501 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ae1c0-155e-4b67-a762-ee3c4a7529a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:27.271981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ae1c0-155e-4b67-a762-ee3c4a7529a1 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:27.280925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ae1c0-155e-4b67-a762-ee3c4a7529a1 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:27.282603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ae1c0-155e-4b67-a762-ee3c4a7529a1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:27.285330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 139/290] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:27 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:27.291026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ae1c0-155e-4b67-a762-ee3c4a7529a1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:27.292037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06082a2-630e-414d-bbd0-b6bad646547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:27.292733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06082a2-630e-414d-bbd0-b6bad646547c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:27.293018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06082a2-630e-414d-bbd0-b6bad646547c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:27.293296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06082a2-630e-414d-bbd0-b6bad646547c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:27.393575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ae1c0-155e-4b67-a762-ee3c4a7529a1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:27.453643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06082a2-630e-414d-bbd0-b6bad646547c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:27.456974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06082a2-630e-414d-bbd0-b6bad646547c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:27.468033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267e70d-589f-4a1b-9bb4-dfbbfbaec8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:27.469355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267e70d-589f-4a1b-9bb4-dfbbfbaec8bd None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:27.469843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267e70d-589f-4a1b-9bb4-dfbbfbaec8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:27.470306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267e70d-589f-4a1b-9bb4-dfbbfbaec8bd None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8/users/0edbdb124ad646b59f0323856bbc92e9/roles/a38d1f35b6dc46adb69b7dc0ea4c9d36` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:27.473348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267e70d-589f-4a1b-9bb4-dfbbfbaec8bd None admin] RBAC: Authorizing `identity:create_grant(project_id=df2f90a9277341e6955ae06c4bf821b8, user_id=0edbdb124ad646b59f0323856bbc92e9, role_id=a38d1f35b6dc46adb69b7dc0ea4c9d36)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:27.475014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267e70d-589f-4a1b-9bb4-dfbbfbaec8bd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:27.486257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:27.578634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 152/291] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:51:27.584409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06082a2-630e-414d-bbd0-b6bad646547c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:27.588266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 140/292] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:51:27 2022] PUT /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8/users/0edbdb124ad646b59f0323856bbc92e9/roles/a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:51:27.723694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06082a2-630e-414d-bbd0-b6bad646547c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:27.745519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:27.770718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ed51a-f7ef-457c-8ff6-03d6557f07f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:27.771601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ed51a-f7ef-457c-8ff6-03d6557f07f1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:27.771889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ed51a-f7ef-457c-8ff6-03d6557f07f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:27.772164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ed51a-f7ef-457c-8ff6-03d6557f07f1 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:27.773432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ed51a-f7ef-457c-8ff6-03d6557f07f1 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:27.774889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ed51a-f7ef-457c-8ff6-03d6557f07f1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:27.776672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 153/293] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:27 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:27.783016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267e70d-589f-4a1b-9bb4-dfbbfbaec8bd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:27.868141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:27.927942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267e70d-589f-4a1b-9bb4-dfbbfbaec8bd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:27.963265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c747d-5d7a-4940-988b-684d9353febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:27.963914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c747d-5d7a-4940-988b-684d9353febf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:27.964191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c747d-5d7a-4940-988b-684d9353febf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:27.964490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c747d-5d7a-4940-988b-684d9353febf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:27.965310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c747d-5d7a-4940-988b-684d9353febf None admin] RBAC: Adding query filter params (role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=df2f90a9277341e6955ae06c4bf821b8, user.id=0b5a1520a6df4acf8f8fd88c7c458923) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:27.965618 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c747d-5d7a-4940-988b-684d9353febf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:27.967049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c747d-5d7a-4940-988b-684d9353febf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:27.973790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 141/294] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:27 2022] GET /identity/v3/role_assignments?user.id=0b5a1520a6df4acf8f8fd88c7c458923&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 610 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:28.644439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bcd33-6f6c-4fa7-a2fd-fefa12da7bd0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:28.644937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bcd33-6f6c-4fa7-a2fd-fefa12da7bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:28.645218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bcd33-6f6c-4fa7-a2fd-fefa12da7bd0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:28.646778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 154/295] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:28.652416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854569ee-0480-4fc2-8ab3-ab1a076fb822 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:28.652879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854569ee-0480-4fc2-8ab3-ab1a076fb822 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:28.652954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854569ee-0480-4fc2-8ab3-ab1a076fb822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:28.671187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-854569ee-0480-4fc2-8ab3-ab1a076fb822 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:28.672381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-854569ee-0480-4fc2-8ab3-ab1a076fb822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:28.751087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 142/296] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:28.766546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c2e3c-47a7-4ab0-b95d-15f7af11237e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:28.766826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c2e3c-47a7-4ab0-b95d-15f7af11237e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:28.767100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c2e3c-47a7-4ab0-b95d-15f7af11237e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:28.768624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 155/297] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:28.777873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06e9d-ab84-48f2-b0d1-90dd7ede9da5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:28.778154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06e9d-ab84-48f2-b0d1-90dd7ede9da5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:28.778420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b06e9d-ab84-48f2-b0d1-90dd7ede9da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:28.781705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c2e3c-47a7-4ab0-b95d-15f7af11237e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:28.803185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-39b06e9d-ab84-48f2-b0d1-90dd7ede9da5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:28.804398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-39b06e9d-ab84-48f2-b0d1-90dd7ede9da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:28.846127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:28.880357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 143/298] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:28.886223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452703-a60a-438c-99bd-e3a5e3c9342a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:28.887070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452703-a60a-438c-99bd-e3a5e3c9342a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:28.887549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452703-a60a-438c-99bd-e3a5e3c9342a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:28.890083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 144/299] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:28 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:28.895545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b578cd4-3f3d-40b1-881e-1ba3a2b045d7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:28.895783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b578cd4-3f3d-40b1-881e-1ba3a2b045d7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:28.896044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b578cd4-3f3d-40b1-881e-1ba3a2b045d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:28.903968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c2e3c-47a7-4ab0-b95d-15f7af11237e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:28.912646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2b578cd4-3f3d-40b1-881e-1ba3a2b045d7 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:28.913836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2b578cd4-3f3d-40b1-881e-1ba3a2b045d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:28.941333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c986a7-d67e-452e-93e2-f4ede8d94519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:28.942120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c986a7-d67e-452e-93e2-f4ede8d94519 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:28.942401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c986a7-d67e-452e-93e2-f4ede8d94519 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:28.942674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c986a7-d67e-452e-93e2-f4ede8d94519 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:28.944065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c986a7-d67e-452e-93e2-f4ede8d94519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:28.945568 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c986a7-d67e-452e-93e2-f4ede8d94519 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:28.948497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 156/300] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:28.948497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c986a7-d67e-452e-93e2-f4ede8d94519 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:28.981450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 145/301] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:28.985153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b578cd4-3f3d-40b1-881e-1ba3a2b045d7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:29.010888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:29.067619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c986a7-d67e-452e-93e2-f4ede8d94519 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.091344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:29.094346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b578cd4-3f3d-40b1-881e-1ba3a2b045d7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.111331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b12f4-7a99-41b7-85bb-9c1d9a36f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.112123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b12f4-7a99-41b7-85bb-9c1d9a36f990 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.112428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b12f4-7a99-41b7-85bb-9c1d9a36f990 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.113295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b12f4-7a99-41b7-85bb-9c1d9a36f990 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.123827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b12f4-7a99-41b7-85bb-9c1d9a36f990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a77b12f4-7a99-41b7-85bb-9c1d9a36f990 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:29.132129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:29.133039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:29.133817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:29.134409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea4289-b976-4ddb-ada1-01d916fed1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.134409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4289-b976-4ddb-ada1-01d916fed1e2 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.134558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 157/302] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:29.134623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4289-b976-4ddb-ada1-01d916fed1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.134623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4289-b976-4ddb-ada1-01d916fed1e2 None admin] PATH_INFO: `/v3/groups` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.136179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea4289-b976-4ddb-ada1-01d916fed1e2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:29.136803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea4289-b976-4ddb-ada1-01d916fed1e2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:29.138743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b12f4-7a99-41b7-85bb-9c1d9a36f990 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:29.225720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 146/303] 10.222.0.123 () {60 vars in 1139 bytes} [Thu May 26 17:51:28 2022] POST /identity/v3/groups => generated 230 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:29.233637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea4289-b976-4ddb-ada1-01d916fed1e2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:29.290236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b12f4-7a99-41b7-85bb-9c1d9a36f990 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.307932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:29.339020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98a6e-d4f1-46f4-bb8d-4b05661f9ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.339504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98a6e-d4f1-46f4-bb8d-4b05661f9ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.339791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98a6e-d4f1-46f4-bb8d-4b05661f9ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.340069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98a6e-d4f1-46f4-bb8d-4b05661f9ae8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.353995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e98a6e-d4f1-46f4-bb8d-4b05661f9ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c0e98a6e-d4f1-46f4-bb8d-4b05661f9ae8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:29.362204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:29.363965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:29.364870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 158/304] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:29.371752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98a6e-d4f1-46f4-bb8d-4b05661f9ae8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:29.378327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea4289-b976-4ddb-ada1-01d916fed1e2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.428859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.429878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.430356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.430824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.431842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:29.432365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:29.433962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:29.444233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 147/305] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:29.449819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:29.482584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:29.499191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98a6e-d4f1-46f4-bb8d-4b05661f9ae8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.540667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.541336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.541671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.541949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.542703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:29.543009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:29.544411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:29.554384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 159/306] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:29 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:29.560935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:29.591474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9992b5e-a96a-4efa-90ec-8345dbc0b4d7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.601054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:29.637970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910c1b-8d84-4c0c-8623-43b474c8ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.638976 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910c1b-8d84-4c0c-8623-43b474c8ae93 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.639865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910c1b-8d84-4c0c-8623-43b474c8ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.640219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910c1b-8d84-4c0c-8623-43b474c8ae93 None admin] PATH_INFO: `/v3/users/c60c5a2bb6314fb3af27d72a1bab81c8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.643020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3910c1b-8d84-4c0c-8623-43b474c8ae93 None admin] RBAC: Authorizing `identity:get_user(user_id=c60c5a2bb6314fb3af27d72a1bab81c8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:29.645159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3910c1b-8d84-4c0c-8623-43b474c8ae93 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:29.647772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 148/307] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:29 2022] GET /identity/v3/users/c60c5a2bb6314fb3af27d72a1bab81c8 => generated 294 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:29.653823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910c1b-8d84-4c0c-8623-43b474c8ae93 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:29.681085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86915b7e-76ba-4639-a0e2-b0ecc6adb8d6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.721553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54cc1e-4276-4587-a551-5f1a00bb23eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.723043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54cc1e-4276-4587-a551-5f1a00bb23eb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.723527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54cc1e-4276-4587-a551-5f1a00bb23eb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.723819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54cc1e-4276-4587-a551-5f1a00bb23eb None admin] PATH_INFO: `/v3/users/e2a871823de44ca49ee7b6c5fd4e2810` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.739445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54cc1e-4276-4587-a551-5f1a00bb23eb None admin] RBAC: Authorizing `identity:get_user(user_id=e2a871823de44ca49ee7b6c5fd4e2810)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:29.741128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54cc1e-4276-4587-a551-5f1a00bb23eb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:29.743011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 160/308] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:29 2022] GET /identity/v3/users/e2a871823de44ca49ee7b6c5fd4e2810 => generated 294 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:29.748603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54cc1e-4276-4587-a551-5f1a00bb23eb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:29.776284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:29.789003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910c1b-8d84-4c0c-8623-43b474c8ae93 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.831942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c171d5-c7db-40f5-abf5-890fdd70a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.832896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c171d5-c7db-40f5-abf5-890fdd70a7ac None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.833102 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c171d5-c7db-40f5-abf5-890fdd70a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.833380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c171d5-c7db-40f5-abf5-890fdd70a7ac None admin] PATH_INFO: `/v3/system/users/c60c5a2bb6314fb3af27d72a1bab81c8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.834954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c171d5-c7db-40f5-abf5-890fdd70a7ac None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c60c5a2bb6314fb3af27d72a1bab81c8, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:29.836607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c171d5-c7db-40f5-abf5-890fdd70a7ac None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:29.861050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:29.871920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54cc1e-4276-4587-a551-5f1a00bb23eb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:29.906659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac58b73-742a-449c-bd7c-8febabe9029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:29.907318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58b73-742a-449c-bd7c-8febabe9029e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:29.907602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58b73-742a-449c-bd7c-8febabe9029e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:29.907876 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58b73-742a-449c-bd7c-8febabe9029e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:29.908740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac58b73-742a-449c-bd7c-8febabe9029e None admin] RBAC: Adding query filter params (role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36, user.id=e2a871823de44ca49ee7b6c5fd4e2810, scope.system=all) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:29.909054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac58b73-742a-449c-bd7c-8febabe9029e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:29.911163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac58b73-742a-449c-bd7c-8febabe9029e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:29.923981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 161/309] 10.222.0.123 () {56 vars in 1313 bytes} [Thu May 26 17:51:29 2022] GET /identity/v3/role_assignments?user.id=e2a871823de44ca49ee7b6c5fd4e2810&scope.system=all&role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 227 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:29.933253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 149/310] 10.222.0.123 () {58 vars in 1339 bytes} [Thu May 26 17:51:29 2022] PUT /identity/v3/system/users/c60c5a2bb6314fb3af27d72a1bab81c8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:30.279519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1fac4-7d0d-45db-af2c-6d8600f50f89 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:30.279892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1fac4-7d0d-45db-af2c-6d8600f50f89 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:30.280111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1fac4-7d0d-45db-af2c-6d8600f50f89 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:30.283527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 162/311] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:30.291322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefc56-3b00-4bcb-84ec-bbf10a77d9c8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:30.291612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefc56-3b00-4bcb-84ec-bbf10a77d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:30.291900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefc56-3b00-4bcb-84ec-bbf10a77d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:30.314255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6afefc56-3b00-4bcb-84ec-bbf10a77d9c8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:30.316483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6afefc56-3b00-4bcb-84ec-bbf10a77d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:30.392401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 150/312] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:30.410469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1fac4-7d0d-45db-af2c-6d8600f50f89 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:30.526889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1fac4-7d0d-45db-af2c-6d8600f50f89 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:30.563707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3d373-7850-4787-8d74-cd78ba23c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:30.564450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d373-7850-4787-8d74-cd78ba23c38a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:30.564732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d373-7850-4787-8d74-cd78ba23c38a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:30.565010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d373-7850-4787-8d74-cd78ba23c38a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:30.575973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3d373-7850-4787-8d74-cd78ba23c38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-27a3d373-7850-4787-8d74-cd78ba23c38a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:30.585182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:30.586065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:30.587017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 163/313] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:30.594757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afefc56-3b00-4bcb-84ec-bbf10a77d9c8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:30.680165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:30.696319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afefc56-3b00-4bcb-84ec-bbf10a77d9c8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:30.735876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:30.736581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:30.736866 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:30.737144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:30.737956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:30.738264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:30.739644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:30.748187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 151/314] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:30 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:30.754464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3d373-7850-4787-8d74-cd78ba23c38a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:30.772965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:30.861598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3d373-7850-4787-8d74-cd78ba23c38a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:30.897817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781552f8-315e-4b24-b168-68a2ffc63054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:30.898751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781552f8-315e-4b24-b168-68a2ffc63054 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:30.899034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781552f8-315e-4b24-b168-68a2ffc63054 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:30.899357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781552f8-315e-4b24-b168-68a2ffc63054 None admin] PATH_INFO: `/v3/users/0edbdb124ad646b59f0323856bbc92e9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:30.900594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781552f8-315e-4b24-b168-68a2ffc63054 None admin] RBAC: Authorizing `identity:get_user(user_id=0edbdb124ad646b59f0323856bbc92e9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:30.902105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781552f8-315e-4b24-b168-68a2ffc63054 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:30.903733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 164/315] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:30 2022] GET /identity/v3/users/0edbdb124ad646b59f0323856bbc92e9 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:30.909224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:31.013241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bd715-57df-4132-b38e-2f442c6f401d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:31.047266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e742bd-42d1-4a74-a070-ebf46df5d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:31.047919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e742bd-42d1-4a74-a070-ebf46df5d8ce None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:31.048204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e742bd-42d1-4a74-a070-ebf46df5d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:31.048512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e742bd-42d1-4a74-a070-ebf46df5d8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:31.069233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:31.121044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e742bd-42d1-4a74-a070-ebf46df5d8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:31.122437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e742bd-42d1-4a74-a070-ebf46df5d8ce None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:31.230998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 152/316] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:31.236588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781552f8-315e-4b24-b168-68a2ffc63054 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:31.334421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:31.353704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781552f8-315e-4b24-b168-68a2ffc63054 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:31.393052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84090d98-d051-4203-b5c8-337e26da6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:31.393863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84090d98-d051-4203-b5c8-337e26da6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:31.394143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84090d98-d051-4203-b5c8-337e26da6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:31.394423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84090d98-d051-4203-b5c8-337e26da6ed2 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:31.395790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84090d98-d051-4203-b5c8-337e26da6ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:31.397270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84090d98-d051-4203-b5c8-337e26da6ed2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:31.399151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 165/317] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:31 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:31.405013 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e742bd-42d1-4a74-a070-ebf46df5d8ce None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:31.454156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:31.508417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e742bd-42d1-4a74-a070-ebf46df5d8ce None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:31.543740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c14a7-7c07-430e-9ac0-f172904d9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:31.544420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c14a7-7c07-430e-9ac0-f172904d9b28 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:31.544704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c14a7-7c07-430e-9ac0-f172904d9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:31.544979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c14a7-7c07-430e-9ac0-f172904d9b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:31.545801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c14a7-7c07-430e-9ac0-f172904d9b28 None admin] RBAC: Adding query filter params (role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36, scope.project.id=df2f90a9277341e6955ae06c4bf821b8, user.id=0edbdb124ad646b59f0323856bbc92e9) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:31.546111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c14a7-7c07-430e-9ac0-f172904d9b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:31.547570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c14a7-7c07-430e-9ac0-f172904d9b28 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:31.552961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f216421-66e3-49a1-bcbd-78ed726cdbf8 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:31.553404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f216421-66e3-49a1-bcbd-78ed726cdbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:31.553816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f216421-66e3-49a1-bcbd-78ed726cdbf8 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:31.555336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 153/319] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:51:31 2022] GET /identity/v3/role_assignments?user.id=0edbdb124ad646b59f0323856bbc92e9&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 610 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:31.555444 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 166/319] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:31.560696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe81a86-f7d0-456c-993b-29dbfff4ac3b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:31.560981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe81a86-f7d0-456c-993b-29dbfff4ac3b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:31.561243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe81a86-f7d0-456c-993b-29dbfff4ac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:31.579831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2fe81a86-f7d0-456c-993b-29dbfff4ac3b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:31.581069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2fe81a86-f7d0-456c-993b-29dbfff4ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:31.655046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 154/320] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:31.678627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f216421-66e3-49a1-bcbd-78ed726cdbf8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:31.792911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f216421-66e3-49a1-bcbd-78ed726cdbf8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:31.828003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655dad-5389-417d-83d7-dad37b489bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:31.828822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655dad-5389-417d-83d7-dad37b489bba None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:31.829098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655dad-5389-417d-83d7-dad37b489bba None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:31.829362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655dad-5389-417d-83d7-dad37b489bba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:31.830517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655dad-5389-417d-83d7-dad37b489bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:31.832514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655dad-5389-417d-83d7-dad37b489bba None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:31.834561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 167/321] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:31 2022] GET /identity/v3/domains/default => generated 200 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:31.839951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe81a86-f7d0-456c-993b-29dbfff4ac3b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:31.888247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:31.949312 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe81a86-f7d0-456c-993b-29dbfff4ac3b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:31.983701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9ad77-05c9-4fa4-b209-6f57b8153306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:31.984381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ad77-05c9-4fa4-b209-6f57b8153306 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:31.984659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ad77-05c9-4fa4-b209-6f57b8153306 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:31.984927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ad77-05c9-4fa4-b209-6f57b8153306 None admin] PATH_INFO: `/v3/groups` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:31.985616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9ad77-05c9-4fa4-b209-6f57b8153306 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:31.987061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9ad77-05c9-4fa4-b209-6f57b8153306 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:32.122641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 155/322] 10.222.0.123 () {60 vars in 1139 bytes} [Thu May 26 17:51:31 2022] POST /identity/v3/groups => generated 227 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:32.324069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29adc2-5851-4310-b094-5dcf8bd1fba1 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:32.324395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29adc2-5851-4310-b094-5dcf8bd1fba1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:32.324676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29adc2-5851-4310-b094-5dcf8bd1fba1 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:32.326180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 168/323] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:32.332286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14425eb-9154-4569-aaef-fdad07ba3981 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:32.332611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14425eb-9154-4569-aaef-fdad07ba3981 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:32.332886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14425eb-9154-4569-aaef-fdad07ba3981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:32.347929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f30e8-f6e3-4047-9061-f5f4c8118c6c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:32.348215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f30e8-f6e3-4047-9061-f5f4c8118c6c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:32.348572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f30e8-f6e3-4047-9061-f5f4c8118c6c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:32.349934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 169/324] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:51:32.350611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f14425eb-9154-4569-aaef-fdad07ba3981 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:32.351809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f14425eb-9154-4569-aaef-fdad07ba3981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:32.355339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e5e5-8b89-4885-8333-d0bec8884ed8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:32.355648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e5e5-8b89-4885-8333-d0bec8884ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:32.355894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e5e5-8b89-4885-8333-d0bec8884ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:32.373160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0252e5e5-8b89-4885-8333-d0bec8884ed8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:32.374340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0252e5e5-8b89-4885-8333-d0bec8884ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:32.390112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:32.430381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 156/325] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:32.451427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 170/326] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:32.454992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14425eb-9154-4569-aaef-fdad07ba3981 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:32.474664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e5e5-8b89-4885-8333-d0bec8884ed8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:32.487387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:32.590377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14425eb-9154-4569-aaef-fdad07ba3981 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:32.611102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e5e5-8b89-4885-8333-d0bec8884ed8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:32.642597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5f695-fd39-48a9-84c3-c39beb171d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:32.643663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f695-fd39-48a9-84c3-c39beb171d6b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:32.644189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f695-fd39-48a9-84c3-c39beb171d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:32.645216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f695-fd39-48a9-84c3-c39beb171d6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:32.653438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d15082-0f1c-4fc9-8274-2253bd0178fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:32.655098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15082-0f1c-4fc9-8274-2253bd0178fe None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:32.655098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15082-0f1c-4fc9-8274-2253bd0178fe None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:32.655098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15082-0f1c-4fc9-8274-2253bd0178fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:32.659489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5f695-fd39-48a9-84c3-c39beb171d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-9ee5f695-fd39-48a9-84c3-c39beb171d6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:32.669046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:32.669968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:32.671674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 157/327] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:32.676083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d15082-0f1c-4fc9-8274-2253bd0178fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:32.676690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5f695-fd39-48a9-84c3-c39beb171d6b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-04d15082-0f1c-4fc9-8274-2253bd0178fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:32.686841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:32.687759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:32.690028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 171/328] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:32.697127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d15082-0f1c-4fc9-8274-2253bd0178fe None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:32.715136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:32.808272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:32.821354 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5f695-fd39-48a9-84c3-c39beb171d6b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:32.823135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d15082-0f1c-4fc9-8274-2253bd0178fe None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:32.867708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:32.869534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:32.870100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:32.870618 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:32.871813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:32.872427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:32.875502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:32.876079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:32.876230 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:32.876677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:32.877025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:32.878134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:32.878719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:32.880548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:32.896430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 158/329] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:32.896964 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 172/330] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:32 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:32.901649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:32.902882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:33.000757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:33.041186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155ddfb-13ce-44e1-b4f3-2558007b4627 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:33.052128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43618b53-f2d1-4421-85f7-4c325a6291af None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:33.098354 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b990e-465e-4d15-9839-d0fd0c6a83a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:33.099472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b990e-465e-4d15-9839-d0fd0c6a83a5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:33.099752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b990e-465e-4d15-9839-d0fd0c6a83a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:33.100019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b990e-465e-4d15-9839-d0fd0c6a83a5 None admin] PATH_INFO: `/v3/users/c60c5a2bb6314fb3af27d72a1bab81c8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:33.101671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b990e-465e-4d15-9839-d0fd0c6a83a5 None admin] RBAC: Authorizing `identity:get_user(user_id=c60c5a2bb6314fb3af27d72a1bab81c8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:33.103271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b990e-465e-4d15-9839-d0fd0c6a83a5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:33.107451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3755ff1-fdab-4b0f-8b80-0391430406c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:33.108598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3755ff1-fdab-4b0f-8b80-0391430406c3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:33.109070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3755ff1-fdab-4b0f-8b80-0391430406c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:33.109551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3755ff1-fdab-4b0f-8b80-0391430406c3 None admin] PATH_INFO: `/v3/users/e2a871823de44ca49ee7b6c5fd4e2810` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:33.109841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 159/331] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:32 2022] GET /identity/v3/users/c60c5a2bb6314fb3af27d72a1bab81c8 => generated 294 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:33.111037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b990e-465e-4d15-9839-d0fd0c6a83a5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:33.111490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3755ff1-fdab-4b0f-8b80-0391430406c3 None admin] RBAC: Authorizing `identity:get_user(user_id=e2a871823de44ca49ee7b6c5fd4e2810)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:33.113215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3755ff1-fdab-4b0f-8b80-0391430406c3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:33.119715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 173/332] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:32 2022] GET /identity/v3/users/e2a871823de44ca49ee7b6c5fd4e2810 => generated 294 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:33.121051 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3755ff1-fdab-4b0f-8b80-0391430406c3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:33.151188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:33.302604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b990e-465e-4d15-9839-d0fd0c6a83a5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:33.325545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3755ff1-fdab-4b0f-8b80-0391430406c3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:33.354715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f951e0-3940-4048-88c2-1d9f3148cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:33.355371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f951e0-3940-4048-88c2-1d9f3148cc3d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:33.355655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f951e0-3940-4048-88c2-1d9f3148cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:33.355928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f951e0-3940-4048-88c2-1d9f3148cc3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:33.357849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f951e0-3940-4048-88c2-1d9f3148cc3d None admin] RBAC: Adding query filter params (role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, user.id=c60c5a2bb6314fb3af27d72a1bab81c8, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:33.358165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f951e0-3940-4048-88c2-1d9f3148cc3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:33.359645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f951e0-3940-4048-88c2-1d9f3148cc3d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:33.385990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 160/333] 10.222.0.123 () {56 vars in 1313 bytes} [Thu May 26 17:51:33 2022] GET /identity/v3/role_assignments?user.id=c60c5a2bb6314fb3af27d72a1bab81c8&scope.system=all&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 512 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:33.404395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424e59b-f6cf-4723-a552-210b9f740803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:33.405302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e59b-f6cf-4723-a552-210b9f740803 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:33.405587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e59b-f6cf-4723-a552-210b9f740803 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:33.405868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e59b-f6cf-4723-a552-210b9f740803 None admin] PATH_INFO: `/v3/system/users/e2a871823de44ca49ee7b6c5fd4e2810/roles/a38d1f35b6dc46adb69b7dc0ea4c9d36` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:33.410359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424e59b-f6cf-4723-a552-210b9f740803 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e2a871823de44ca49ee7b6c5fd4e2810, role_id=a38d1f35b6dc46adb69b7dc0ea4c9d36)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:33.411817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424e59b-f6cf-4723-a552-210b9f740803 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:33.526982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 174/334] 10.222.0.123 () {58 vars in 1339 bytes} [Thu May 26 17:51:33 2022] PUT /identity/v3/system/users/e2a871823de44ca49ee7b6c5fd4e2810/roles/a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:35.484458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c44b7e-084c-4925-89e7-54092c212999 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:35.484974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c44b7e-084c-4925-89e7-54092c212999 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:35.485049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c44b7e-084c-4925-89e7-54092c212999 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:35.486369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 161/335] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:35.492758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee00e-d159-47a8-960f-610136160444 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:35.493237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee00e-d159-47a8-960f-610136160444 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:35.493310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ee00e-d159-47a8-960f-610136160444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:35.498376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:35.521565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-156ee00e-d159-47a8-960f-610136160444 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:35.522789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-156ee00e-d159-47a8-960f-610136160444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:35.611997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 175/336] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:35.648370 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c44b7e-084c-4925-89e7-54092c212999 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:35.755185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:35.780215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c44b7e-084c-4925-89e7-54092c212999 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:35.823547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c0467-9b46-4cfc-a473-4ba684e3c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:35.824717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c0467-9b46-4cfc-a473-4ba684e3c3fe None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:35.825219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c0467-9b46-4cfc-a473-4ba684e3c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:35.825682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c0467-9b46-4cfc-a473-4ba684e3c3fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:35.843566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c0467-9b46-4cfc-a473-4ba684e3c3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-bc7c0467-9b46-4cfc-a473-4ba684e3c3fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:35.852078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:35.853037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:35.853811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:35.860411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 162/337] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:35.862670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ee00e-d159-47a8-960f-610136160444 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:35.916105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9f0a-0852-4d1d-9188-d024808041e0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:35.916856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9f0a-0852-4d1d-9188-d024808041e0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:35.917341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd9f0a-0852-4d1d-9188-d024808041e0 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:35.919326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 163/338] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:35.925269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625e79-88dc-4c58-ac69-167760ee0ad0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:35.926348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625e79-88dc-4c58-ac69-167760ee0ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:35.926842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625e79-88dc-4c58-ac69-167760ee0ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:35.957902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-00625e79-88dc-4c58-ac69-167760ee0ad0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:35.959450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-00625e79-88dc-4c58-ac69-167760ee0ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:36.071930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ee00e-d159-47a8-960f-610136160444 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:36.105313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 164/339] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:36.107091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879569-8aa3-4173-8f5e-fe446a2c6fec None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.107601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879569-8aa3-4173-8f5e-fe446a2c6fec None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.108069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879569-8aa3-4173-8f5e-fe446a2c6fec None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.109719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 165/340] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:36.119711 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ba1a-3fcf-41b6-8c6a-4d83661b0fe9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.120292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ba1a-3fcf-41b6-8c6a-4d83661b0fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.120806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ba1a-3fcf-41b6-8c6a-4d83661b0fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.136701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:36.143426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:36.144151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.144459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.144730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.145492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:36.145796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:36.147214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:36.151151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e562ba1a-3fcf-41b6-8c6a-4d83661b0fe9 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:36.152363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e562ba1a-3fcf-41b6-8c6a-4d83661b0fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:36.160092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 176/341] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:35 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:36.162271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:36.248762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:36.260388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 166/342] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:36.262525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341d0f-3ce1-4ec0-a365-474022fcd9ff None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.263046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341d0f-3ce1-4ec0-a365-474022fcd9ff None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.263518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341d0f-3ce1-4ec0-a365-474022fcd9ff None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.270940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 167/343] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:36 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:36.272635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f341d0f-3ce1-4ec0-a365-474022fcd9ff None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:36.310138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7701c-5fc3-4061-91ea-8b70436f2185 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:36.351195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca1a12-aed7-4ace-8786-85dc44fb8ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:36.352456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1a12-aed7-4ace-8786-85dc44fb8ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.352993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1a12-aed7-4ace-8786-85dc44fb8ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.353472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1a12-aed7-4ace-8786-85dc44fb8ca9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.368157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca1a12-aed7-4ace-8786-85dc44fb8ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0eca1a12-aed7-4ace-8786-85dc44fb8ca9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:36.377590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:36.379452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:36.380476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:36.382465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 177/344] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:36.385423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1bc5-3cf3-4d51-b26e-2b53a93e8476 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.385882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1bc5-3cf3-4d51-b26e-2b53a93e8476 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.386297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1bc5-3cf3-4d51-b26e-2b53a93e8476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.405918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-045c1bc5-3cf3-4d51-b26e-2b53a93e8476 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:36.407350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-045c1bc5-3cf3-4d51-b26e-2b53a93e8476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:36.455316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f341d0f-3ce1-4ec0-a365-474022fcd9ff None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:36.474351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:36.497455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 178/345] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:36.498949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c1bc5-3cf3-4d51-b26e-2b53a93e8476 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:36.503227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f804b2-ead2-4aeb-a748-e1583ffdded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:36.503227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f804b2-ead2-4aeb-a748-e1583ffdded2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.503227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f804b2-ead2-4aeb-a748-e1583ffdded2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.503227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f804b2-ead2-4aeb-a748-e1583ffdded2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.597859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:36.602717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f804b2-ead2-4aeb-a748-e1583ffdded2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:36.604569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f804b2-ead2-4aeb-a748-e1583ffdded2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:36.655905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c1bc5-3cf3-4d51-b26e-2b53a93e8476 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:36.704753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26336e2-b3f5-46d1-a3b5-173f0d2aa3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:36.706112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26336e2-b3f5-46d1-a3b5-173f0d2aa3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.706647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26336e2-b3f5-46d1-a3b5-173f0d2aa3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.707591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26336e2-b3f5-46d1-a3b5-173f0d2aa3a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.722546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26336e2-b3f5-46d1-a3b5-173f0d2aa3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a26336e2-b3f5-46d1-a3b5-173f0d2aa3a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:36.734299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:36.735396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:36.736185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:36.737838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 179/346] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:36.744655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26336e2-b3f5-46d1-a3b5-173f0d2aa3a5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:36.756134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 168/347] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:36.756942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f804b2-ead2-4aeb-a748-e1583ffdded2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:36.806969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:36.885702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26336e2-b3f5-46d1-a3b5-173f0d2aa3a5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:36.886507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:36.890317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f804b2-ead2-4aeb-a748-e1583ffdded2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:36.929684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:36.930596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.930885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.931162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.931921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:36.932232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:36.933662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:36.938251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e13485-4b1c-42bb-bb48-ddbf62160171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:36.939041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e13485-4b1c-42bb-bb48-ddbf62160171 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.939778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e13485-4b1c-42bb-bb48-ddbf62160171 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.940054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e13485-4b1c-42bb-bb48-ddbf62160171 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.943063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 180/348] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:36 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:36.943743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:36.962694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e13485-4b1c-42bb-bb48-ddbf62160171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-92e13485-4b1c-42bb-bb48-ddbf62160171 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:36.972468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:36.973416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:36.974625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 169/349] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:36.975482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d798909-2287-41ea-aed1-ad7f9d123964 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:36.975482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d798909-2287-41ea-aed1-ad7f9d123964 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:36.975482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d798909-2287-41ea-aed1-ad7f9d123964 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:36.976964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 170/350] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:36.977506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d798909-2287-41ea-aed1-ad7f9d123964 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:37.079092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de13e5-bee5-4e92-bff6-f88c84cc229f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:37.088241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:37.106575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d798909-2287-41ea-aed1-ad7f9d123964 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:37.131893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:37.132609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:37.132894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:37.133172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:37.133995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:37.134309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:37.135700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:37.148262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 181/351] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:36 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:37.150328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:37.163210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0af3-c2c0-4138-85c9-f766e3ec9bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:37.164093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0af3-c2c0-4138-85c9-f766e3ec9bcb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:37.164830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0af3-c2c0-4138-85c9-f766e3ec9bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:37.164830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0af3-c2c0-4138-85c9-f766e3ec9bcb None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:37.165966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec0af3-c2c0-4138-85c9-f766e3ec9bcb None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:37.167423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec0af3-c2c0-4138-85c9-f766e3ec9bcb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:37.169144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 171/352] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:36 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:37.169889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0af3-c2c0-4138-85c9-f766e3ec9bcb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:37.211234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:37.319884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d54d-6cc9-45ee-83bb-14af53b8b0ef None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:37.333612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0af3-c2c0-4138-85c9-f766e3ec9bcb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:37.374991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23942640-35b9-4830-bce0-c89eeb127a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:37.375442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23942640-35b9-4830-bce0-c89eeb127a23 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:37.375685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23942640-35b9-4830-bce0-c89eeb127a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:37.376006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23942640-35b9-4830-bce0-c89eeb127a23 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:37.376716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23942640-35b9-4830-bce0-c89eeb127a23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:37.378431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23942640-35b9-4830-bce0-c89eeb127a23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:37.378996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23942640-35b9-4830-bce0-c89eeb127a23 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:37.383744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef72f-24f1-40c2-83ae-e8504141afe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:37.384624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef72f-24f1-40c2-83ae-e8504141afe5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:37.385036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef72f-24f1-40c2-83ae-e8504141afe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:37.385900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef72f-24f1-40c2-83ae-e8504141afe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:37.389731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 172/353] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:37.393841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd94f8-714b-4fef-ad86-43aaff921b0b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:37.394332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd94f8-714b-4fef-ad86-43aaff921b0b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:37.394738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd94f8-714b-4fef-ad86-43aaff921b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:37.418858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-dbbd94f8-714b-4fef-ad86-43aaff921b0b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:37.420064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dbbd94f8-714b-4fef-ad86-43aaff921b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:37.451660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:37.514286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ef72f-24f1-40c2-83ae-e8504141afe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:37.515727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ef72f-24f1-40c2-83ae-e8504141afe5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:37.529957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 173/354] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:37.530751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd94f8-714b-4fef-ad86-43aaff921b0b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:37.554356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:37.642976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 182/355] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:37.643864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef72f-24f1-40c2-83ae-e8504141afe5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:37.662252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd94f8-714b-4fef-ad86-43aaff921b0b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:37.706894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0c6f-3845-430f-93dd-1ae451269add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:37.707719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0c6f-3845-430f-93dd-1ae451269add None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:37.708064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0c6f-3845-430f-93dd-1ae451269add None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:37.709080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0c6f-3845-430f-93dd-1ae451269add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:37.728093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:37.767899 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef72f-24f1-40c2-83ae-e8504141afe5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:37.795120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b0c6f-3845-430f-93dd-1ae451269add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:37.797078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b0c6f-3845-430f-93dd-1ae451269add None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:37.816054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e8bf-cb63-4530-9d25-0603511ff07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:37.817295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e8bf-cb63-4530-9d25-0603511ff07a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:37.817576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e8bf-cb63-4530-9d25-0603511ff07a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:37.817846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e8bf-cb63-4530-9d25-0603511ff07a None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:37.818976 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:37.827643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70e8bf-cb63-4530-9d25-0603511ff07a None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:37.827643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70e8bf-cb63-4530-9d25-0603511ff07a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:37.829651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 183/356] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:37 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:37.830470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e8bf-cb63-4530-9d25-0603511ff07a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:37.919970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 174/357] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:37.921907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80c50-491b-4f2b-858e-a8b1319d73ef None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:37.922398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80c50-491b-4f2b-858e-a8b1319d73ef None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:37.922892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80c50-491b-4f2b-858e-a8b1319d73ef None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:37.924415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 175/358] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:37.925626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80c50-491b-4f2b-858e-a8b1319d73ef None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:37.956573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e8bf-cb63-4530-9d25-0603511ff07a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:37.992750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:37.999260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb670916-8f24-43b2-a61f-0951b6405f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.000153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb670916-8f24-43b2-a61f-0951b6405f87 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.000273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb670916-8f24-43b2-a61f-0951b6405f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.000478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb670916-8f24-43b2-a61f-0951b6405f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.052182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80c50-491b-4f2b-858e-a8b1319d73ef None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.074218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:38.095305 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d503c-3cd2-405c-bdf5-b9602879a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.095499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb670916-8f24-43b2-a61f-0951b6405f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.095733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d503c-3cd2-405c-bdf5-b9602879a69b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.098495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d503c-3cd2-405c-bdf5-b9602879a69b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.098495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d503c-3cd2-405c-bdf5-b9602879a69b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.098751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb670916-8f24-43b2-a61f-0951b6405f87 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.109118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d503c-3cd2-405c-bdf5-b9602879a69b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b07d503c-3cd2-405c-bdf5-b9602879a69b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:38.117122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:38.118018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 176/359] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:38.119229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d503c-3cd2-405c-bdf5-b9602879a69b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.216389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 184/360] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:38.217325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb670916-8f24-43b2-a61f-0951b6405f87 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.247361 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d503c-3cd2-405c-bdf5-b9602879a69b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.255251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:38.293572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910a58-0cb2-4a56-9557-5431aeb5a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.295431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910a58-0cb2-4a56-9557-5431aeb5a4ea None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.295431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910a58-0cb2-4a56-9557-5431aeb5a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.295431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910a58-0cb2-4a56-9557-5431aeb5a4ea None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.296177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68910a58-0cb2-4a56-9557-5431aeb5a4ea None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.297682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68910a58-0cb2-4a56-9557-5431aeb5a4ea None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.299725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 177/361] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:38.300926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910a58-0cb2-4a56-9557-5431aeb5a4ea None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.341323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb670916-8f24-43b2-a61f-0951b6405f87 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.354053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:38.375229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c9af8-10b8-4f0f-9d60-ae8b5d99a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.375877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c9af8-10b8-4f0f-9d60-ae8b5d99a104 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.376160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c9af8-10b8-4f0f-9d60-ae8b5d99a104 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.376469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c9af8-10b8-4f0f-9d60-ae8b5d99a104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.377291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c9af8-10b8-4f0f-9d60-ae8b5d99a104 None admin] RBAC: Adding query filter params (group.id=a244f3d38ab7498fb35ab7dab4db0088, role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=6a5c72aa29764ef48849de4944696987) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:38.377603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c9af8-10b8-4f0f-9d60-ae8b5d99a104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.379862 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c9af8-10b8-4f0f-9d60-ae8b5d99a104 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.385396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 185/362] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/role_assignments?group.id=a244f3d38ab7498fb35ab7dab4db0088&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 261 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:38.386577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb524-7d9d-4401-94c7-313e820587a5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.386864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb524-7d9d-4401-94c7-313e820587a5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.387146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb524-7d9d-4401-94c7-313e820587a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.404766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-448eb524-7d9d-4401-94c7-313e820587a5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:38.406008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-448eb524-7d9d-4401-94c7-313e820587a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:38.413960 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68910a58-0cb2-4a56-9557-5431aeb5a4ea None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.455107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81b8c7-a983-41df-9170-c1a92e74e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.456333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b8c7-a983-41df-9170-c1a92e74e53a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.456652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b8c7-a983-41df-9170-c1a92e74e53a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.456919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b8c7-a983-41df-9170-c1a92e74e53a None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.458157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81b8c7-a983-41df-9170-c1a92e74e53a None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.459626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81b8c7-a983-41df-9170-c1a92e74e53a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.461394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 178/363] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:38.462197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81b8c7-a983-41df-9170-c1a92e74e53a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.489856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 186/364] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:38.490729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448eb524-7d9d-4401-94c7-313e820587a5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.530308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:38.596120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81b8c7-a983-41df-9170-c1a92e74e53a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.607898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448eb524-7d9d-4401-94c7-313e820587a5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.611404 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:38.633471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.634137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.634420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.634701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.635443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:38.635751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.637160 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.644759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c119-52ba-48ab-b270-4cae1af586e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.645627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c119-52ba-48ab-b270-4cae1af586e7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.650356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 179/365] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:38.650479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c119-52ba-48ab-b270-4cae1af586e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.650479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c119-52ba-48ab-b270-4cae1af586e7 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.650655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.651505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c119-52ba-48ab-b270-4cae1af586e7 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.653078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c119-52ba-48ab-b270-4cae1af586e7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.654790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 187/366] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:38.655555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c119-52ba-48ab-b270-4cae1af586e7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.758244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:38.764490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c119-52ba-48ab-b270-4cae1af586e7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.765546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d78f32-1529-44a2-a094-4b516b2e81af None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.799260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071adb2-695e-465c-8f9f-3f513d2e998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.800119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071adb2-695e-465c-8f9f-3f513d2e998d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.801071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071adb2-695e-465c-8f9f-3f513d2e998d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.801345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071adb2-695e-465c-8f9f-3f513d2e998d None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.802495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071adb2-695e-465c-8f9f-3f513d2e998d None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.803255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e597-0ca3-40c5-be55-f912995346a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.803923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071adb2-695e-465c-8f9f-3f513d2e998d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.804094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e597-0ca3-40c5-be55-f912995346a1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.804383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e597-0ca3-40c5-be55-f912995346a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.804648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e597-0ca3-40c5-be55-f912995346a1 None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.810357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 188/367] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:38.810505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0e597-0ca3-40c5-be55-f912995346a1 None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.810582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071adb2-695e-465c-8f9f-3f513d2e998d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.810650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0e597-0ca3-40c5-be55-f912995346a1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.810650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 180/368] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:38.810650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e597-0ca3-40c5-be55-f912995346a1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.859082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:38.914340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e597-0ca3-40c5-be55-f912995346a1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.919257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071adb2-695e-465c-8f9f-3f513d2e998d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:38.949452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22352-25d8-4a80-becd-838687532340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.950431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22352-25d8-4a80-becd-838687532340 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.950712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22352-25d8-4a80-becd-838687532340 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.950997 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22352-25d8-4a80-becd-838687532340 None admin] PATH_INFO: `/v3/users/e2a871823de44ca49ee7b6c5fd4e2810` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.952221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a22352-25d8-4a80-becd-838687532340 None admin] RBAC: Authorizing `identity:get_user(user_id=e2a871823de44ca49ee7b6c5fd4e2810)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:38.953739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a22352-25d8-4a80-becd-838687532340 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:38.954843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e6ce-74fe-4a0b-9958-f32fab739cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:38.960243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 181/369] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/users/e2a871823de44ca49ee7b6c5fd4e2810 => generated 294 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:38.960482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e6ce-74fe-4a0b-9958-f32fab739cac None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:38.960482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e6ce-74fe-4a0b-9958-f32fab739cac None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:38.960648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22352-25d8-4a80-becd-838687532340 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:38.960732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e6ce-74fe-4a0b-9958-f32fab739cac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:38.971066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e6ce-74fe-4a0b-9958-f32fab739cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b4b6e6ce-74fe-4a0b-9958-f32fab739cac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:38.979370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:38.980259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:38.981119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 189/370] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:38.981767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e6ce-74fe-4a0b-9958-f32fab739cac None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:39.010136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:39.076075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22352-25d8-4a80-becd-838687532340 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:39.091133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:39.093512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e6ce-74fe-4a0b-9958-f32fab739cac None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:39.113033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfd90-536e-4264-b285-5e84e1dcee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:39.114307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfd90-536e-4264-b285-5e84e1dcee62 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:39.114591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfd90-536e-4264-b285-5e84e1dcee62 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:39.114862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edfd90-536e-4264-b285-5e84e1dcee62 None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:39.116045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edfd90-536e-4264-b285-5e84e1dcee62 None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:39.117518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edfd90-536e-4264-b285-5e84e1dcee62 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:39.124175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 182/371] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:39.124175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfd90-536e-4264-b285-5e84e1dcee62 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:39.135127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:39.135792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:39.136079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:39.136394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:39.137227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] RBAC: Adding query filter params (group.id=a244f3d38ab7498fb35ab7dab4db0088, role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=6a5c72aa29764ef48849de4944696987) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:39.137542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:39.138979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:39.145497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 190/372] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:38 2022] GET /identity/v3/role_assignments?group.id=a244f3d38ab7498fb35ab7dab4db0088&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=6b666ed01b97482497ff1f656ecff898 => generated 261 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:39.146296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:39.260633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:39.279969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edfd90-536e-4264-b285-5e84e1dcee62 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:39.288280 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76ac00-1116-4211-a0f5-b5647200ab89 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:39.319288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:39.320061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:39.320570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:39.320963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:39.321864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] RBAC: Adding query filter params (group.id=a244f3d38ab7498fb35ab7dab4db0088, role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=df2f90a9277341e6955ae06c4bf821b8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:39.322255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:39.323827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:39.330857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 183/373] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:39 2022] GET /identity/v3/role_assignments?group.id=a244f3d38ab7498fb35ab7dab4db0088&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=6b666ed01b97482497ff1f656ecff898 => generated 261 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:39.332474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:39.349096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:39.352547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:39.352977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:39.353360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:39.354358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] RBAC: Adding query filter params (role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36, user.id=e2a871823de44ca49ee7b6c5fd4e2810, scope.system=all) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:39.355147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:39.356454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:39.371936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 191/374] 10.222.0.123 () {56 vars in 1313 bytes} [Thu May 26 17:51:39 2022] GET /identity/v3/role_assignments?user.id=e2a871823de44ca49ee7b6c5fd4e2810&scope.system=all&role.id=a38d1f35b6dc46adb69b7dc0ea4c9d36 => generated 512 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:39.376382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:39.409204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:39.485724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7704796-23e7-46ef-9eb6-ce01d1888972 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:39.535538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:39.536550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:39.536992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:39.537428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:39.538657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:39.539105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:39.540998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:39.553286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 184/375] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:39.560471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:39.625854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ed260-68f7-48cd-a3b7-60d610ad8e52 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:39.694187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15f515-3cb9-489a-987f-728ae90eecec None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:39.698852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:39.699624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:39.700011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:39.700416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:39.701355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] RBAC: Adding query filter params (group.id=a244f3d38ab7498fb35ab7dab4db0088, role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=df2f90a9277341e6955ae06c4bf821b8) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:39.701792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:39.703314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:39.703524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:39.718506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 192/376] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:39 2022] GET /identity/v3/role_assignments?group.id=a244f3d38ab7498fb35ab7dab4db0088&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 261 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:39.738241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3706c-3ad3-42cc-a872-cdcc99db7cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:39.739244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3706c-3ad3-42cc-a872-cdcc99db7cff None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:39.739689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3706c-3ad3-42cc-a872-cdcc99db7cff None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:39.740111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3706c-3ad3-42cc-a872-cdcc99db7cff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:39.818909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3706c-3ad3-42cc-a872-cdcc99db7cff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:39.820735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3706c-3ad3-42cc-a872-cdcc99db7cff None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:39.934792 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 185/377] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:39.940170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:39.967420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:40.080256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b1d16-db24-4bf9-88bf-cb95087d46c6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:40.115808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f6c8f-4300-4f00-ab91-bead8ff8c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:40.116700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f6c8f-4300-4f00-ab91-bead8ff8c106 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:40.116979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f6c8f-4300-4f00-ab91-bead8ff8c106 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:40.117249 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f6c8f-4300-4f00-ab91-bead8ff8c106 None admin] PATH_INFO: `/v3/projects/c5b85a0a8c034126972b9b0b0e372a47` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:40.118438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f6c8f-4300-4f00-ab91-bead8ff8c106 None admin] RBAC: Authorizing `identity:get_project(project_id=c5b85a0a8c034126972b9b0b0e372a47)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:40.119870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f6c8f-4300-4f00-ab91-bead8ff8c106 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:40.121932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 193/378] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:39 2022] GET /identity/v3/projects/c5b85a0a8c034126972b9b0b0e372a47 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:40.127136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3706c-3ad3-42cc-a872-cdcc99db7cff None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:40.138863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:40.263738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3706c-3ad3-42cc-a872-cdcc99db7cff None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:40.311444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53bd19-997a-46ec-97e9-b49b41be9a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:40.312319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bd19-997a-46ec-97e9-b49b41be9a2d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:40.312607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bd19-997a-46ec-97e9-b49b41be9a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:40.312883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bd19-997a-46ec-97e9-b49b41be9a2d None admin] PATH_INFO: `/v3/groups/500bb6c6451946baa6f52b72858305c4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:40.323238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53bd19-997a-46ec-97e9-b49b41be9a2d None admin] RBAC: Authorizing `identity:get_group(group_id=500bb6c6451946baa6f52b72858305c4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:40.324811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53bd19-997a-46ec-97e9-b49b41be9a2d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:40.326837 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 186/379] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:40 2022] GET /identity/v3/groups/500bb6c6451946baa6f52b72858305c4 => generated 230 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:40.333253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f6c8f-4300-4f00-ab91-bead8ff8c106 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:40.451713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:40.480579 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f6c8f-4300-4f00-ab91-bead8ff8c106 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:40.521815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430798ac-a7f0-4a35-a789-da361497dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:40.522393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430798ac-a7f0-4a35-a789-da361497dc13 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:40.522669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430798ac-a7f0-4a35-a789-da361497dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:40.522939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430798ac-a7f0-4a35-a789-da361497dc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:40.523769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430798ac-a7f0-4a35-a789-da361497dc13 None admin] RBAC: Adding query filter params (group.id=500bb6c6451946baa6f52b72858305c4, role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=c5b85a0a8c034126972b9b0b0e372a47) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:40.524080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430798ac-a7f0-4a35-a789-da361497dc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:40.525540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430798ac-a7f0-4a35-a789-da361497dc13 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:40.532629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 194/380] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:40 2022] GET /identity/v3/role_assignments?group.id=500bb6c6451946baa6f52b72858305c4&scope.project.id=c5b85a0a8c034126972b9b0b0e372a47&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 261 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:40.919092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735df8e-bec8-463f-b74b-477ea7ce7432 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:40.919555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735df8e-bec8-463f-b74b-477ea7ce7432 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:40.919555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735df8e-bec8-463f-b74b-477ea7ce7432 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:40.920971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 187/381] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:40.927090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca87d1-e21f-48ac-acbf-7a7a172fe574 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:40.927571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca87d1-e21f-48ac-acbf-7a7a172fe574 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:40.927646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca87d1-e21f-48ac-acbf-7a7a172fe574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:40.946889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a5ca87d1-e21f-48ac-acbf-7a7a172fe574 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:40.948915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a5ca87d1-e21f-48ac-acbf-7a7a172fe574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:41.064858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 195/382] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:41.103951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735df8e-bec8-463f-b74b-477ea7ce7432 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:41.246945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:41.313016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735df8e-bec8-463f-b74b-477ea7ce7432 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:41.359467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d5ce-2582-46fc-98b9-e1998b4e0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:41.360250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d5ce-2582-46fc-98b9-e1998b4e0e47 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:41.360644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d5ce-2582-46fc-98b9-e1998b4e0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:41.360915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d5ce-2582-46fc-98b9-e1998b4e0e47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:41.379532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220d5ce-2582-46fc-98b9-e1998b4e0e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4220d5ce-2582-46fc-98b9-e1998b4e0e47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:41.387314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:41.388221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:41.389058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 188/383] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:41.398911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca87d1-e21f-48ac-acbf-7a7a172fe574 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:41.530785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:41.586102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca87d1-e21f-48ac-acbf-7a7a172fe574 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:41.661778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:41.662457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:41.662740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:41.663013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:41.663756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:41.664058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:41.669693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:41.678691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 196/384] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:41 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:41.684275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d5ce-2582-46fc-98b9-e1998b4e0e47 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:41.833553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d5ce-2582-46fc-98b9-e1998b4e0e47 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:41.873822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:41.884965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123aa961-fc07-4aa3-b885-6765eae530d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:41.893481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123aa961-fc07-4aa3-b885-6765eae530d8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:41.893481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123aa961-fc07-4aa3-b885-6765eae530d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:41.893481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123aa961-fc07-4aa3-b885-6765eae530d8 None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:41.893481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123aa961-fc07-4aa3-b885-6765eae530d8 None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:41.893481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123aa961-fc07-4aa3-b885-6765eae530d8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:41.893481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 189/385] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:41 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:41.896807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:42.016001 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd93623-4c7a-4943-a439-224cc1dbbbb1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:42.046037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:42.051134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d16af8-a3ee-42d8-beb9-9fc3eebd58b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:42.051999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16af8-a3ee-42d8-beb9-9fc3eebd58b3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:42.052278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16af8-a3ee-42d8-beb9-9fc3eebd58b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:42.052586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d16af8-a3ee-42d8-beb9-9fc3eebd58b3 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:42.053958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d16af8-a3ee-42d8-beb9-9fc3eebd58b3 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:42.055398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d16af8-a3ee-42d8-beb9-9fc3eebd58b3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:42.057368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 197/386] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:41 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:42.065373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123aa961-fc07-4aa3-b885-6765eae530d8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:42.141263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344ebbc-feaf-42dc-b08e-23c11ffc5b41 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:42.141871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344ebbc-feaf-42dc-b08e-23c11ffc5b41 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:42.142345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344ebbc-feaf-42dc-b08e-23c11ffc5b41 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:42.145634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 198/387] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:51:42.150601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95943a2-dfb9-44ff-ac43-265f657f4d4f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:42.151337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95943a2-dfb9-44ff-ac43-265f657f4d4f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:42.151991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95943a2-dfb9-44ff-ac43-265f657f4d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:42.171360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b95943a2-dfb9-44ff-ac43-265f657f4d4f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:42.173053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b95943a2-dfb9-44ff-ac43-265f657f4d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:42.216873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123aa961-fc07-4aa3-b885-6765eae530d8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:42.251977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b97a2-bd67-4402-a880-3edc74e47718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:42.252899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b97a2-bd67-4402-a880-3edc74e47718 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:42.253178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b97a2-bd67-4402-a880-3edc74e47718 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:42.255722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b97a2-bd67-4402-a880-3edc74e47718 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987/groups/a244f3d38ab7498fb35ab7dab4db0088/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:42.258420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b97a2-bd67-4402-a880-3edc74e47718 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c72aa29764ef48849de4944696987, group_id=a244f3d38ab7498fb35ab7dab4db0088, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:42.258420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b97a2-bd67-4402-a880-3edc74e47718 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:42.286424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 199/388] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:42.315741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95943a2-dfb9-44ff-ac43-265f657f4d4f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:42.350716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 190/389] 10.222.0.123 () {58 vars in 1447 bytes} [Thu May 26 17:51:42 2022] PUT /identity/v3/projects/6a5c72aa29764ef48849de4944696987/groups/a244f3d38ab7498fb35ab7dab4db0088/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:42.454418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95943a2-dfb9-44ff-ac43-265f657f4d4f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:42.494188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:42.506036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db364493-fb64-4e97-88e1-875a2a1ea370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:42.507639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db364493-fb64-4e97-88e1-875a2a1ea370 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:42.507639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db364493-fb64-4e97-88e1-875a2a1ea370 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:42.507639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db364493-fb64-4e97-88e1-875a2a1ea370 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:42.525954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db364493-fb64-4e97-88e1-875a2a1ea370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-db364493-fb64-4e97-88e1-875a2a1ea370 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:42.535863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:42.536873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:42.537644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:42.543167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 200/390] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:42.544392 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b97a2-bd67-4402-a880-3edc74e47718 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:42.619732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:42.665116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b97a2-bd67-4402-a880-3edc74e47718 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:42.699815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4683a-c679-4642-b303-2ecfb638021f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:42.700132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4683a-c679-4642-b303-2ecfb638021f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:42.700392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4683a-c679-4642-b303-2ecfb638021f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:42.702309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 201/391] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:51:42.706133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:42.707208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:42.707811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:42.708129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e4456-9998-4cfd-be93-a82b7f5d89cd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:42.708332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:42.708798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e4456-9998-4cfd-be93-a82b7f5d89cd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:42.709079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:42.709437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:42.709696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e4456-9998-4cfd-be93-a82b7f5d89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:42.710836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:42.720806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 191/392] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:42 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:42.726936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:42.749389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7a6e4456-9998-4cfd-be93-a82b7f5d89cd None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:42.750621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7a6e4456-9998-4cfd-be93-a82b7f5d89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:42.845671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 202/393] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:42.867826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e4456-9998-4cfd-be93-a82b7f5d89cd None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:42.935634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610236b4-244b-49bb-8ff3-fa215a551bc8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:42.976780 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:43.001454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02d89b-2bc6-4f70-b711-f447f78e0a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:43.002320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d89b-2bc6-4f70-b711-f447f78e0a7b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.002605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d89b-2bc6-4f70-b711-f447f78e0a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.002880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d89b-2bc6-4f70-b711-f447f78e0a7b None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.005666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02d89b-2bc6-4f70-b711-f447f78e0a7b None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:43.010424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02d89b-2bc6-4f70-b711-f447f78e0a7b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:43.017632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 192/394] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:42 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:43.018563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02d89b-2bc6-4f70-b711-f447f78e0a7b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:43.079911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e4456-9998-4cfd-be93-a82b7f5d89cd None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.115635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:43.131035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b0a2-0e38-4d32-8b81-143a199f9fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:43.132364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b0a2-0e38-4d32-8b81-143a199f9fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.132785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b0a2-0e38-4d32-8b81-143a199f9fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.133193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b0a2-0e38-4d32-8b81-143a199f9fa9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.148007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074b0a2-0e38-4d32-8b81-143a199f9fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6074b0a2-0e38-4d32-8b81-143a199f9fa9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:43.159027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:43.160692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:43.161665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:43.164583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 203/395] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:43.166761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c0b-07be-4a8f-9bb6-d4b7fc1d49c6 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.167189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c0b-07be-4a8f-9bb6-d4b7fc1d49c6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.167873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c0b-07be-4a8f-9bb6-d4b7fc1d49c6 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.170370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 204/396] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:43.171224 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8c0b-07be-4a8f-9bb6-d4b7fc1d49c6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:43.181465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02d89b-2bc6-4f70-b711-f447f78e0a7b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.221861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd4165-b0f6-41fb-997c-88e8e1ab1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:43.223557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4165-b0f6-41fb-997c-88e8e1ab1407 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.223942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4165-b0f6-41fb-997c-88e8e1ab1407 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.224359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4165-b0f6-41fb-997c-88e8e1ab1407 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.226673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd4165-b0f6-41fb-997c-88e8e1ab1407 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:43.228381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd4165-b0f6-41fb-997c-88e8e1ab1407 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:43.235062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 193/397] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:43 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:43.235062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826d94-79ef-4be6-9c5a-29101f198fee None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.235062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826d94-79ef-4be6-9c5a-29101f198fee None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.235062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826d94-79ef-4be6-9c5a-29101f198fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.258942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e7826d94-79ef-4be6-9c5a-29101f198fee None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:43.260724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e7826d94-79ef-4be6-9c5a-29101f198fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:43.325657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8c0b-07be-4a8f-9bb6-d4b7fc1d49c6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.332969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:43.351305 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 194/398] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:43.352483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7826d94-79ef-4be6-9c5a-29101f198fee None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:43.382947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:43.383622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.383905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.384181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.385048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:43.385353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:43.386768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:43.395994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 205/399] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:43.396919 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:43.444253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:43.466095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7826d94-79ef-4be6-9c5a-29101f198fee None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.508136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cb5f5-e9fe-4841-bd9a-81c2bebe0485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:43.509033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cb5f5-e9fe-4841-bd9a-81c2bebe0485 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.509316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cb5f5-e9fe-4841-bd9a-81c2bebe0485 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.509411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09f95d-a053-4e75-bcd8-c3717be7ad17 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.509605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cb5f5-e9fe-4841-bd9a-81c2bebe0485 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8/groups/a244f3d38ab7498fb35ab7dab4db0088/roles/6b666ed01b97482497ff1f656ecff898` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.512064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cb5f5-e9fe-4841-bd9a-81c2bebe0485 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2f90a9277341e6955ae06c4bf821b8, group_id=a244f3d38ab7498fb35ab7dab4db0088, role_id=6b666ed01b97482497ff1f656ecff898)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:43.513543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cb5f5-e9fe-4841-bd9a-81c2bebe0485 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:43.543028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b60c05-3886-40fc-99e6-faefa5031208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:43.543854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b60c05-3886-40fc-99e6-faefa5031208 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.544127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b60c05-3886-40fc-99e6-faefa5031208 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.544423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b60c05-3886-40fc-99e6-faefa5031208 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.554959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b60c05-3886-40fc-99e6-faefa5031208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b1b60c05-3886-40fc-99e6-faefa5031208 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:43.562635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:43.563701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 206/400] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:43.564791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b60c05-3886-40fc-99e6-faefa5031208 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:43.584357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 195/401] 10.222.0.123 () {58 vars in 1447 bytes} [Thu May 26 17:51:43 2022] PUT /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8/groups/a244f3d38ab7498fb35ab7dab4db0088/roles/6b666ed01b97482497ff1f656ecff898 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:43.584357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a48539-5554-4247-bc16-63e917a37e69 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.584357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a48539-5554-4247-bc16-63e917a37e69 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.584357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a48539-5554-4247-bc16-63e917a37e69 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.584357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 196/402] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:43.584357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a48539-5554-4247-bc16-63e917a37e69 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:43.651614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:43.719835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b60c05-3886-40fc-99e6-faefa5031208 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.722544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:43.741748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a48539-5554-4247-bc16-63e917a37e69 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.764211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17974abe-cf50-4809-bc5e-658054703fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:43.765328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974abe-cf50-4809-bc5e-658054703fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.765755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974abe-cf50-4809-bc5e-658054703fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.766216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974abe-cf50-4809-bc5e-658054703fc1 None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.768840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17974abe-cf50-4809-bc5e-658054703fc1 None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:43.771910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17974abe-cf50-4809-bc5e-658054703fc1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:43.775008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 207/403] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:43 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:43.782545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac5a63-825a-4a68-9d71-4c8e18679aa1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.782545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac5a63-825a-4a68-9d71-4c8e18679aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.782545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac5a63-825a-4a68-9d71-4c8e18679aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.789669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:43.790609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:43.790897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:43.791171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:43.792947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:43.796329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:43.796329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:43.805272 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-97ac5a63-825a-4a68-9d71-4c8e18679aa1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:43.806571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-97ac5a63-825a-4a68-9d71-4c8e18679aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:43.809645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 197/404] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:43.810671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:43.892327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 208/405] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:43.892327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac5a63-825a-4a68-9d71-4c8e18679aa1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:43.953605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994dd13-2679-430f-ab9d-b15669f4605a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.973158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:43.992734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:43.995550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac5a63-825a-4a68-9d71-4c8e18679aa1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:43.999607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf342d7-c2e4-4d51-bae6-eb5dbe04d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.000685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf342d7-c2e4-4d51-bae6-eb5dbe04d691 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.001143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf342d7-c2e4-4d51-bae6-eb5dbe04d691 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.001559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf342d7-c2e4-4d51-bae6-eb5dbe04d691 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.002958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf342d7-c2e4-4d51-bae6-eb5dbe04d691 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:44.004925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf342d7-c2e4-4d51-bae6-eb5dbe04d691 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:44.006794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 198/406] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:43 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:44.007715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf342d7-c2e4-4d51-bae6-eb5dbe04d691 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:44.037984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70e4db-3b4b-4612-b5e9-672c152a14dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.037984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70e4db-3b4b-4612-b5e9-672c152a14dc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.037984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70e4db-3b4b-4612-b5e9-672c152a14dc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.037984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70e4db-3b4b-4612-b5e9-672c152a14dc None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.038356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70e4db-3b4b-4612-b5e9-672c152a14dc None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:44.038356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70e4db-3b4b-4612-b5e9-672c152a14dc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:44.039808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 209/407] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:43 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:44.040732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70e4db-3b4b-4612-b5e9-672c152a14dc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:44.123208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf342d7-c2e4-4d51-bae6-eb5dbe04d691 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:44.152623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70e4db-3b4b-4612-b5e9-672c152a14dc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:44.164011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414417d-b027-495d-99d9-02e14bf8e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.165272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414417d-b027-495d-99d9-02e14bf8e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.165758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414417d-b027-495d-99d9-02e14bf8e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.166226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414417d-b027-495d-99d9-02e14bf8e5f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.181455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414417d-b027-495d-99d9-02e14bf8e5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d414417d-b027-495d-99d9-02e14bf8e5f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:44.189540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:44.190824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:44.191641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:44.194219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 199/408] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:44.195228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414417d-b027-495d-99d9-02e14bf8e5f2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:44.195704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb245e-e962-4e16-b4f1-7e76ee65b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.196715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb245e-e962-4e16-b4f1-7e76ee65b248 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.196995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb245e-e962-4e16-b4f1-7e76ee65b248 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.197261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb245e-e962-4e16-b4f1-7e76ee65b248 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987/groups/a244f3d38ab7498fb35ab7dab4db0088/roles/6b666ed01b97482497ff1f656ecff898` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.199851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb245e-e962-4e16-b4f1-7e76ee65b248 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c72aa29764ef48849de4944696987, group_id=a244f3d38ab7498fb35ab7dab4db0088, role_id=6b666ed01b97482497ff1f656ecff898)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:44.202703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb245e-e962-4e16-b4f1-7e76ee65b248 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:44.234880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:44.304947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 210/409] 10.222.0.123 () {58 vars in 1447 bytes} [Thu May 26 17:51:44 2022] PUT /identity/v3/projects/6a5c72aa29764ef48849de4944696987/groups/a244f3d38ab7498fb35ab7dab4db0088/roles/6b666ed01b97482497ff1f656ecff898 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:51:44.306027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb245e-e962-4e16-b4f1-7e76ee65b248 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:44.312235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414417d-b027-495d-99d9-02e14bf8e5f2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:44.344637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:44.354479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146d50a-bcd9-4ba7-97d3-36a351c7dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.356109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146d50a-bcd9-4ba7-97d3-36a351c7dd71 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.356805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146d50a-bcd9-4ba7-97d3-36a351c7dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.357789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146d50a-bcd9-4ba7-97d3-36a351c7dd71 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.359364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146d50a-bcd9-4ba7-97d3-36a351c7dd71 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:44.361210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146d50a-bcd9-4ba7-97d3-36a351c7dd71 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:44.363749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 200/410] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:44 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:44.369091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146d50a-bcd9-4ba7-97d3-36a351c7dd71 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:44.436787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb245e-e962-4e16-b4f1-7e76ee65b248 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:44.516120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.516848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.517131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.517401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.518241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:44.518550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:44.521057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:44.531434 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 211/411] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:44 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:44.538486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:44.550676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146d50a-bcd9-4ba7-97d3-36a351c7dd71 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:44.559168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:44.603955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b5d3f-6893-4336-83a6-0a1cfcc7bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.604886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5d3f-6893-4336-83a6-0a1cfcc7bb6d None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.605170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5d3f-6893-4336-83a6-0a1cfcc7bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.605442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5d3f-6893-4336-83a6-0a1cfcc7bb6d None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8/groups/a244f3d38ab7498fb35ab7dab4db0088/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.607721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b5d3f-6893-4336-83a6-0a1cfcc7bb6d None admin] RBAC: Authorizing `identity:create_grant(project_id=df2f90a9277341e6955ae06c4bf821b8, group_id=a244f3d38ab7498fb35ab7dab4db0088, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:44.609212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b5d3f-6893-4336-83a6-0a1cfcc7bb6d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:44.657113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:44.669697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de10ca-08e6-45e5-9550-4ee995853f86 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:44.695380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 201/412] 10.222.0.123 () {58 vars in 1447 bytes} [Thu May 26 17:51:44 2022] PUT /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8/groups/a244f3d38ab7498fb35ab7dab4db0088/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:51:44.720060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c99a84-b1a3-4214-8b99-ec057f2eb2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.721080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c99a84-b1a3-4214-8b99-ec057f2eb2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.721362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c99a84-b1a3-4214-8b99-ec057f2eb2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.721683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c99a84-b1a3-4214-8b99-ec057f2eb2e0 None admin] PATH_INFO: `/v3/groups/500bb6c6451946baa6f52b72858305c4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.723650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c99a84-b1a3-4214-8b99-ec057f2eb2e0 None admin] RBAC: Authorizing `identity:get_group(group_id=500bb6c6451946baa6f52b72858305c4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:44.725386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c99a84-b1a3-4214-8b99-ec057f2eb2e0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:44.727526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 212/413] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:44 2022] GET /identity/v3/groups/500bb6c6451946baa6f52b72858305c4 => generated 230 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:44.733401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b5d3f-6893-4336-83a6-0a1cfcc7bb6d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:44.884686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b5d3f-6893-4336-83a6-0a1cfcc7bb6d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:44.930227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265799-b9d1-475f-ad0b-72bca224c798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:44.931098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265799-b9d1-475f-ad0b-72bca224c798 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.931386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265799-b9d1-475f-ad0b-72bca224c798 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.931718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265799-b9d1-475f-ad0b-72bca224c798 None admin] PATH_INFO: `/v3/projects/c5b85a0a8c034126972b9b0b0e372a47` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.932952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3265799-b9d1-475f-ad0b-72bca224c798 None admin] RBAC: Authorizing `identity:get_project(project_id=c5b85a0a8c034126972b9b0b0e372a47)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:44.933269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175054-aba7-47d0-8df6-306bdab56f2d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.933563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175054-aba7-47d0-8df6-306bdab56f2d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.933843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175054-aba7-47d0-8df6-306bdab56f2d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.934397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3265799-b9d1-475f-ad0b-72bca224c798 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:44.935449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 213/414] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:44.936076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 202/415] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:44 2022] GET /identity/v3/projects/c5b85a0a8c034126972b9b0b0e372a47 => generated 345 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:44.940359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe392e-22ba-49b8-8eae-580c7607c32d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:44.940655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe392e-22ba-49b8-8eae-580c7607c32d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:44.940937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe392e-22ba-49b8-8eae-580c7607c32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:44.945137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265799-b9d1-475f-ad0b-72bca224c798 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:44.963010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0dfe392e-22ba-49b8-8eae-580c7607c32d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:44.964218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0dfe392e-22ba-49b8-8eae-580c7607c32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:44.984163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:45.056863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 214/416] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:45.086471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe392e-22ba-49b8-8eae-580c7607c32d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:45.103268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265799-b9d1-475f-ad0b-72bca224c798 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:45.172489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a08d23-33b1-47de-b184-e749e4ccf805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:45.173273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a08d23-33b1-47de-b184-e749e4ccf805 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:45.173548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a08d23-33b1-47de-b184-e749e4ccf805 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:45.173816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a08d23-33b1-47de-b184-e749e4ccf805 None admin] PATH_INFO: `/v3/projects/c5b85a0a8c034126972b9b0b0e372a47/groups/500bb6c6451946baa6f52b72858305c4/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:45.177388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a08d23-33b1-47de-b184-e749e4ccf805 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5b85a0a8c034126972b9b0b0e372a47, group_id=500bb6c6451946baa6f52b72858305c4, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:45.178835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a08d23-33b1-47de-b184-e749e4ccf805 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:45.207092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:45.219771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe392e-22ba-49b8-8eae-580c7607c32d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:45.255853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd5064-209a-4f07-b7b7-f7738f656ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:45.256721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd5064-209a-4f07-b7b7-f7738f656ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:45.257004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd5064-209a-4f07-b7b7-f7738f656ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:45.257275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd5064-209a-4f07-b7b7-f7738f656ba5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:45.268149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd5064-209a-4f07-b7b7-f7738f656ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:45.270876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 203/417] 10.222.0.123 () {58 vars in 1447 bytes} [Thu May 26 17:51:44 2022] PUT /identity/v3/projects/c5b85a0a8c034126972b9b0b0e372a47/groups/500bb6c6451946baa6f52b72858305c4/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e6dd5064-209a-4f07-b7b7-f7738f656ba5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:45.278079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:45.279029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:45.279829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:45.281246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 215/418] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:45.287104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a08d23-33b1-47de-b184-e749e4ccf805 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:45.412281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:45.432144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a08d23-33b1-47de-b184-e749e4ccf805 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:45.470361 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:45.471177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:45.471491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:45.471779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:45.473301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:45.476947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:45.478704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:45.494891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 204/419] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:45.500384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd5064-209a-4f07-b7b7-f7738f656ba5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:45.619850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd5064-209a-4f07-b7b7-f7738f656ba5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:45.654974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61da21-e8a1-40bf-8cf9-6b1d1d0ccf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:45.655624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61da21-e8a1-40bf-8cf9-6b1d1d0ccf56 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:45.655901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61da21-e8a1-40bf-8cf9-6b1d1d0ccf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:45.656176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61da21-e8a1-40bf-8cf9-6b1d1d0ccf56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:45.684933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:45.731072 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61da21-e8a1-40bf-8cf9-6b1d1d0ccf56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:45.732585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61da21-e8a1-40bf-8cf9-6b1d1d0ccf56 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:45.853486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 216/420] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:45.861162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:46.000536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c37e40-68bb-419c-855f-9736b666f26e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:46.042697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196d62-370b-4540-95e3-97f8b3e8a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:46.043549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196d62-370b-4540-95e3-97f8b3e8a89e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:46.043823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196d62-370b-4540-95e3-97f8b3e8a89e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:46.044095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196d62-370b-4540-95e3-97f8b3e8a89e None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:46.045313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196d62-370b-4540-95e3-97f8b3e8a89e None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:46.046750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196d62-370b-4540-95e3-97f8b3e8a89e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:46.048766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 205/421] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:45 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:46.057286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61da21-e8a1-40bf-8cf9-6b1d1d0ccf56 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:46.132740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:46.211062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61da21-e8a1-40bf-8cf9-6b1d1d0ccf56 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:46.249832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fe9cb-75fc-48cc-9651-aed22b046ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:46.250748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fe9cb-75fc-48cc-9651-aed22b046ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:46.250971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fe9cb-75fc-48cc-9651-aed22b046ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:46.251239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fe9cb-75fc-48cc-9651-aed22b046ee8 None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:46.252438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fe9cb-75fc-48cc-9651-aed22b046ee8 None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:46.254464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fe9cb-75fc-48cc-9651-aed22b046ee8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:46.256087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 217/422] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:46 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:46.265507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196d62-370b-4540-95e3-97f8b3e8a89e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:46.327280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:46.362956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985575-6c59-492c-945f-9df1b6a10666 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:46.363678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985575-6c59-492c-945f-9df1b6a10666 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:46.364249 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985575-6c59-492c-945f-9df1b6a10666 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:46.366248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 218/423] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:46.371617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65098981-913a-4c60-824b-a5c9b09a7833 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:46.372166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65098981-913a-4c60-824b-a5c9b09a7833 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:46.372656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65098981-913a-4c60-824b-a5c9b09a7833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:46.401781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-65098981-913a-4c60-824b-a5c9b09a7833 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:46.403324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-65098981-913a-4c60-824b-a5c9b09a7833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:46.450322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196d62-370b-4540-95e3-97f8b3e8a89e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:46.498296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 219/424] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:46.521525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:46.522557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:46.523015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:46.523483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:46.525006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] RBAC: Adding query filter params (group.id=a244f3d38ab7498fb35ab7dab4db0088, role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=6a5c72aa29764ef48849de4944696987) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:46.525503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:46.527973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:46.538569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 206/425] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:46 2022] GET /identity/v3/role_assignments?group.id=a244f3d38ab7498fb35ab7dab4db0088&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 613 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:46.555546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65098981-913a-4c60-824b-a5c9b09a7833 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:46.659884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:46.736347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65098981-913a-4c60-824b-a5c9b09a7833 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:46.795055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61e165-8e25-40e0-a892-8ab91bb817f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:46.796228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61e165-8e25-40e0-a892-8ab91bb817f7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:46.796756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61e165-8e25-40e0-a892-8ab91bb817f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:46.797160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61e165-8e25-40e0-a892-8ab91bb817f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:46.824215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61e165-8e25-40e0-a892-8ab91bb817f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ca61e165-8e25-40e0-a892-8ab91bb817f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:46.838761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:46.839743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:46.840586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:46.841183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 220/426] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:46.847506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:46.961966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:46.986691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b186-dec9-4783-a664-8d88442e78f4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:47.049557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f8b04-84a7-47c6-9892-17278926903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:47.051608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f8b04-84a7-47c6-9892-17278926903b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.052171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f8b04-84a7-47c6-9892-17278926903b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.052657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f8b04-84a7-47c6-9892-17278926903b None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.053632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f8b04-84a7-47c6-9892-17278926903b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:47.054488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f8b04-84a7-47c6-9892-17278926903b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:47.058809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f8b04-84a7-47c6-9892-17278926903b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:47.071936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 207/427] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:46 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:47.077910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61e165-8e25-40e0-a892-8ab91bb817f7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:47.205821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61e165-8e25-40e0-a892-8ab91bb817f7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:47.213636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:47.242325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cd13d-63cc-4f7e-89c3-91c6f6fc68cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:47.242980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cd13d-63cc-4f7e-89c3-91c6f6fc68cf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.243260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cd13d-63cc-4f7e-89c3-91c6f6fc68cf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.243537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cd13d-63cc-4f7e-89c3-91c6f6fc68cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.257428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c9ff-d2df-4393-a12c-13583e5d9309 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.257769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c9ff-d2df-4393-a12c-13583e5d9309 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.258050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8c9ff-d2df-4393-a12c-13583e5d9309 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.261427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 208/428] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:47.265738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979513-b610-48e4-b209-95f2657ae85a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.266028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979513-b610-48e4-b209-95f2657ae85a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.266306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979513-b610-48e4-b209-95f2657ae85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.313042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f8979513-b610-48e4-b209-95f2657ae85a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:47.314256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f8979513-b610-48e4-b209-95f2657ae85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:47.333787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cd13d-63cc-4f7e-89c3-91c6f6fc68cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:47.335343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cd13d-63cc-4f7e-89c3-91c6f6fc68cf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:47.459734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 221/429] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:47.465139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cd13d-63cc-4f7e-89c3-91c6f6fc68cf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:47.465367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 209/430] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:47.480741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:47.499920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979513-b610-48e4-b209-95f2657ae85a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:47.609564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:47.620129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cd13d-63cc-4f7e-89c3-91c6f6fc68cf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:47.637927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979513-b610-48e4-b209-95f2657ae85a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:47.672408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc6bc9-7c06-4512-9ee6-2334f03e3a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:47.673653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6bc9-7c06-4512-9ee6-2334f03e3a44 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.674151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6bc9-7c06-4512-9ee6-2334f03e3a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.674620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6bc9-7c06-4512-9ee6-2334f03e3a44 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.676262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc6bc9-7c06-4512-9ee6-2334f03e3a44 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:47.677974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc6bc9-7c06-4512-9ee6-2334f03e3a44 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:47.680257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 222/431] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:47 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:47.686067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc6bc9-7c06-4512-9ee6-2334f03e3a44 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:47.687077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ca0f8-0736-46ae-8f7d-20e4b0fd8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:47.687980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ca0f8-0736-46ae-8f7d-20e4b0fd8e9e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.688243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ca0f8-0736-46ae-8f7d-20e4b0fd8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.688555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ca0f8-0736-46ae-8f7d-20e4b0fd8e9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.702668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ca0f8-0736-46ae-8f7d-20e4b0fd8e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4c8ca0f8-0736-46ae-8f7d-20e4b0fd8e9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:47.712353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:47.713301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:47.714097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:47.723164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 210/432] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:47.724943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ca0f8-0736-46ae-8f7d-20e4b0fd8e9e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:47.799745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:47.829205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc6bc9-7c06-4512-9ee6-2334f03e3a44 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:47.847971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ca0f8-0736-46ae-8f7d-20e4b0fd8e9e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:47.871932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13f6c7-6919-4832-b46d-cf7356bcd229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:47.872747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13f6c7-6919-4832-b46d-cf7356bcd229 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.873024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13f6c7-6919-4832-b46d-cf7356bcd229 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.873293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13f6c7-6919-4832-b46d-cf7356bcd229 None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.874484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13f6c7-6919-4832-b46d-cf7356bcd229 None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:47.876007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13f6c7-6919-4832-b46d-cf7356bcd229 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:47.879622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 223/433] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:47 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:47.880790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861e82-8ef1-411f-ac4a-06e4e7c74008 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.881054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861e82-8ef1-411f-ac4a-06e4e7c74008 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.881328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861e82-8ef1-411f-ac4a-06e4e7c74008 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.882755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 224/434] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:47.887334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861e82-8ef1-411f-ac4a-06e4e7c74008 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:47.906539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cc000-05ed-4be7-8b96-5ab54a0b09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:47.907799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc000-05ed-4be7-8b96-5ab54a0b09ed None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.908221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc000-05ed-4be7-8b96-5ab54a0b09ed None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.908668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc000-05ed-4be7-8b96-5ab54a0b09ed None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.909547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cc000-05ed-4be7-8b96-5ab54a0b09ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:47.910007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cc000-05ed-4be7-8b96-5ab54a0b09ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:47.911397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cc000-05ed-4be7-8b96-5ab54a0b09ed None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:47.917591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:47.924461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 211/435] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:47.925868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d98df-b3c9-4b89-a028-a7ccfffc27e8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:47.926281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d98df-b3c9-4b89-a028-a7ccfffc27e8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:47.926565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d98df-b3c9-4b89-a028-a7ccfffc27e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:47.946015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9c5d98df-b3c9-4b89-a028-a7ccfffc27e8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:47.947219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9c5d98df-b3c9-4b89-a028-a7ccfffc27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:48.002391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861e82-8ef1-411f-ac4a-06e4e7c74008 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.024537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 212/436] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:48.024537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d98df-b3c9-4b89-a028-a7ccfffc27e8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.052024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.053068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.053351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.053627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.064166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] RBAC: Adding query filter params (group.id=a244f3d38ab7498fb35ab7dab4db0088, role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=df2f90a9277341e6955ae06c4bf821b8) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:48.064166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:48.064166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:48.080331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 225/437] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:47 2022] GET /identity/v3/role_assignments?group.id=a244f3d38ab7498fb35ab7dab4db0088&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=6b666ed01b97482497ff1f656ecff898 => generated 613 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:48.080331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.095552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:48.148416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d98df-b3c9-4b89-a028-a7ccfffc27e8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.183605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:48.190738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a6961-9374-41e2-81c5-695f7505187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.192319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6961-9374-41e2-81c5-695f7505187c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.192761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6961-9374-41e2-81c5-695f7505187c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.197959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6961-9374-41e2-81c5-695f7505187c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.226687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b8c2-f90a-434d-b6f3-bd4124094e80 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.270046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a6961-9374-41e2-81c5-695f7505187c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:48.270446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e6516-0105-44ad-a7a4-d149de60e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.271420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6516-0105-44ad-a7a4-d149de60e897 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.271878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6516-0105-44ad-a7a4-d149de60e897 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.272257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a6961-9374-41e2-81c5-695f7505187c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:48.272476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6516-0105-44ad-a7a4-d149de60e897 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.293527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e6516-0105-44ad-a7a4-d149de60e897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9f2e6516-0105-44ad-a7a4-d149de60e897 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:48.302042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:48.302895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:48.303676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 226/438] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:48.304974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1e11-ae66-49ba-b05d-3ab7bb01e84c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.304974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1e11-ae66-49ba-b05d-3ab7bb01e84c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.305222 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1e11-ae66-49ba-b05d-3ab7bb01e84c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.308737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 227/439] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:48.308889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f1e11-ae66-49ba-b05d-3ab7bb01e84c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.388843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:48.390877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 213/440] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:48.392217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda964c-f8a3-4a45-8940-ce1bec35eef0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.392532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda964c-f8a3-4a45-8940-ce1bec35eef0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.392801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda964c-f8a3-4a45-8940-ce1bec35eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.408602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-feda964c-f8a3-4a45-8940-ce1bec35eef0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:48.409697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-feda964c-f8a3-4a45-8940-ce1bec35eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:48.423491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f1e11-ae66-49ba-b05d-3ab7bb01e84c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.433326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:48.457742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.458393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.458675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.458949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.459684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:48.459990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:48.461426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:48.469334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 228/441] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:48.474512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.477249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 214/442] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:48.478075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda964c-f8a3-4a45-8940-ce1bec35eef0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.568886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d41db4-30dc-48e2-ae76-95c16a431ef6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.592277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda964c-f8a3-4a45-8940-ce1bec35eef0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.595050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:48.603489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1370d-5f53-4ef5-b2e2-9431d42d1952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.609024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1370d-5f53-4ef5-b2e2-9431d42d1952 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.609024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1370d-5f53-4ef5-b2e2-9431d42d1952 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.609024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1370d-5f53-4ef5-b2e2-9431d42d1952 None admin] PATH_INFO: `/v3/projects/6a5c72aa29764ef48849de4944696987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.609024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1370d-5f53-4ef5-b2e2-9431d42d1952 None admin] RBAC: Authorizing `identity:get_project(project_id=6a5c72aa29764ef48849de4944696987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:48.609024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1370d-5f53-4ef5-b2e2-9431d42d1952 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:48.609357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 229/443] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/projects/6a5c72aa29764ef48849de4944696987 => generated 299 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:48.609989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1370d-5f53-4ef5-b2e2-9431d42d1952 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.631884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3ca5-37ee-455d-be98-207719f62d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.632564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3ca5-37ee-455d-be98-207719f62d0a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.632847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3ca5-37ee-455d-be98-207719f62d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.633124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3ca5-37ee-455d-be98-207719f62d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.661849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:48.699636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3ca5-37ee-455d-be98-207719f62d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:48.701106 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3ca5-37ee-455d-be98-207719f62d0a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:48.708163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1370d-5f53-4ef5-b2e2-9431d42d1952 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.742605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4939-3e17-4863-bc9d-805c80bdd776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.743384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4939-3e17-4863-bc9d-805c80bdd776 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.743667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4939-3e17-4863-bc9d-805c80bdd776 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.743938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4939-3e17-4863-bc9d-805c80bdd776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.754285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee4939-3e17-4863-bc9d-805c80bdd776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-afee4939-3e17-4863-bc9d-805c80bdd776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:48.761735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:48.762720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:48.763495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 230/444] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:48.764162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4939-3e17-4863-bc9d-805c80bdd776 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.802731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 215/445] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:48.803554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3ca5-37ee-455d-be98-207719f62d0a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.832619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:48.861661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:48.875721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4939-3e17-4863-bc9d-805c80bdd776 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.901083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3ca5-37ee-455d-be98-207719f62d0a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:48.909090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eb2c5-2f48-40a5-8841-e19bd3a16543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.910488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb2c5-2f48-40a5-8841-e19bd3a16543 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.910774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb2c5-2f48-40a5-8841-e19bd3a16543 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.911048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb2c5-2f48-40a5-8841-e19bd3a16543 None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.912282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eb2c5-2f48-40a5-8841-e19bd3a16543 None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:48.914116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eb2c5-2f48-40a5-8841-e19bd3a16543 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:48.915965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 231/446] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:48.916496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eb2c5-2f48-40a5-8841-e19bd3a16543 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:48.936023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:48.936727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:48.937014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:48.937286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:48.938022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:48.938325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:48.939694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:48.948909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 216/447] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:48.949774 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:49.022794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eb2c5-2f48-40a5-8841-e19bd3a16543 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:49.047374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:49.049982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c6af0-d943-4cad-a9b9-95d4f848b43e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:49.058075 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812994cb-6148-4ce8-be64-9d79a7ba9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:49.058928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812994cb-6148-4ce8-be64-9d79a7ba9148 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:49.059212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812994cb-6148-4ce8-be64-9d79a7ba9148 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:49.059486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812994cb-6148-4ce8-be64-9d79a7ba9148 None admin] PATH_INFO: `/v3/projects/df2f90a9277341e6955ae06c4bf821b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:49.060972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812994cb-6148-4ce8-be64-9d79a7ba9148 None admin] RBAC: Authorizing `identity:get_project(project_id=df2f90a9277341e6955ae06c4bf821b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:49.062402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812994cb-6148-4ce8-be64-9d79a7ba9148 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:49.064078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 232/448] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/projects/df2f90a9277341e6955ae06c4bf821b8 => generated 303 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:49.064855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812994cb-6148-4ce8-be64-9d79a7ba9148 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:49.073245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:49.085263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:49.085909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:49.086195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:49.086470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:49.087289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] RBAC: Adding query filter params (group.id=a244f3d38ab7498fb35ab7dab4db0088, role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=6a5c72aa29764ef48849de4944696987) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:49.087595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:49.089049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:49.094746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 217/449] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:48 2022] GET /identity/v3/role_assignments?group.id=a244f3d38ab7498fb35ab7dab4db0088&scope.project.id=6a5c72aa29764ef48849de4944696987&role.id=6b666ed01b97482497ff1f656ecff898 => generated 613 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:49.095502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:49.192938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812994cb-6148-4ce8-be64-9d79a7ba9148 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:49.216943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c66add-f69b-49d4-8ab5-7a4875d4d50c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:49.229045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa56df-f619-4511-b7a2-2c8d5a15934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:49.229706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa56df-f619-4511-b7a2-2c8d5a15934c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:49.229985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa56df-f619-4511-b7a2-2c8d5a15934c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:49.230261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa56df-f619-4511-b7a2-2c8d5a15934c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:49.258306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6af09-5c2d-494a-8ee3-bc6caef1ed46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:49.259179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6af09-5c2d-494a-8ee3-bc6caef1ed46 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:49.259459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6af09-5c2d-494a-8ee3-bc6caef1ed46 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:49.259731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6af09-5c2d-494a-8ee3-bc6caef1ed46 None admin] PATH_INFO: `/v3/groups/a244f3d38ab7498fb35ab7dab4db0088` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:49.260959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6af09-5c2d-494a-8ee3-bc6caef1ed46 None admin] RBAC: Authorizing `identity:get_group(group_id=a244f3d38ab7498fb35ab7dab4db0088)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:49.262431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6af09-5c2d-494a-8ee3-bc6caef1ed46 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:49.264109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 218/450] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:49 2022] GET /identity/v3/groups/a244f3d38ab7498fb35ab7dab4db0088 => generated 227 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:49.270529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6af09-5c2d-494a-8ee3-bc6caef1ed46 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:49.310362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:49.320287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa56df-f619-4511-b7a2-2c8d5a15934c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:49.321779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa56df-f619-4511-b7a2-2c8d5a15934c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:49.341180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:49.398584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6af09-5c2d-494a-8ee3-bc6caef1ed46 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:49.436572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:49.437227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:49.437553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:49.437836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:49.438663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] RBAC: Adding query filter params (group.id=a244f3d38ab7498fb35ab7dab4db0088, role.id=4d22d1a6df3d4e74b94189c29cd1fd5c, scope.project.id=df2f90a9277341e6955ae06c4bf821b8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:49.438977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:49.440459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:49.444036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 233/451] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:49.449219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 219/452] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:49 2022] GET /identity/v3/role_assignments?group.id=a244f3d38ab7498fb35ab7dab4db0088&scope.project.id=df2f90a9277341e6955ae06c4bf821b8&role.id=4d22d1a6df3d4e74b94189c29cd1fd5c => generated 613 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:49.449581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa56df-f619-4511-b7a2-2c8d5a15934c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:49.556469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:49.565307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa56df-f619-4511-b7a2-2c8d5a15934c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:49.601648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1e161-bf86-4060-80ac-984ee032cf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:49.602523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e161-bf86-4060-80ac-984ee032cf32 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:49.602802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e161-bf86-4060-80ac-984ee032cf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:49.603077 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e161-bf86-4060-80ac-984ee032cf32 None admin] PATH_INFO: `/v3/projects/c5b85a0a8c034126972b9b0b0e372a47` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:49.604297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1e161-bf86-4060-80ac-984ee032cf32 None admin] RBAC: Authorizing `identity:get_project(project_id=c5b85a0a8c034126972b9b0b0e372a47)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:49.605768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1e161-bf86-4060-80ac-984ee032cf32 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:49.607490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 234/453] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:51:49 2022] GET /identity/v3/projects/c5b85a0a8c034126972b9b0b0e372a47 => generated 345 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:51:49.613751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:49.717807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09735e8-0ccc-4ea4-9ed1-1b8da7e88b40 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:49.734590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:49.751199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b618ce-0987-4c6d-b048-b344715f91c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:49.752039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b618ce-0987-4c6d-b048-b344715f91c8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:49.752355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b618ce-0987-4c6d-b048-b344715f91c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:49.752616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b618ce-0987-4c6d-b048-b344715f91c8 None admin] PATH_INFO: `/v3/groups/500bb6c6451946baa6f52b72858305c4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:49.754425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b618ce-0987-4c6d-b048-b344715f91c8 None admin] RBAC: Authorizing `identity:get_group(group_id=500bb6c6451946baa6f52b72858305c4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:49.756032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b618ce-0987-4c6d-b048-b344715f91c8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:49.757670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 220/454] 10.222.0.123 () {56 vars in 1185 bytes} [Thu May 26 17:51:49 2022] GET /identity/v3/groups/500bb6c6451946baa6f52b72858305c4 => generated 230 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:49.763583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1e161-bf86-4060-80ac-984ee032cf32 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:49.869108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1e161-bf86-4060-80ac-984ee032cf32 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:49.908493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee634b1-fba4-49e5-b63f-a88a00cbb462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:49.909486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee634b1-fba4-49e5-b63f-a88a00cbb462 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:49.909977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee634b1-fba4-49e5-b63f-a88a00cbb462 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:49.910390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee634b1-fba4-49e5-b63f-a88a00cbb462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:49.911703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee634b1-fba4-49e5-b63f-a88a00cbb462 None admin] RBAC: Adding query filter params (group.id=500bb6c6451946baa6f52b72858305c4, role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=c5b85a0a8c034126972b9b0b0e372a47) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:49.912171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee634b1-fba4-49e5-b63f-a88a00cbb462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:49.914465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee634b1-fba4-49e5-b63f-a88a00cbb462 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:49.922848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 235/455] 10.222.0.123 () {56 vars in 1381 bytes} [Thu May 26 17:51:49 2022] GET /identity/v3/role_assignments?group.id=500bb6c6451946baa6f52b72858305c4&scope.project.id=c5b85a0a8c034126972b9b0b0e372a47&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 613 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:52.706250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6db23-17ec-478c-b0e8-2de2a04a388b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:52.706776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6db23-17ec-478c-b0e8-2de2a04a388b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:52.706776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6db23-17ec-478c-b0e8-2de2a04a388b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:52.709265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 221/456] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:52.715005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a697ed1-d4ed-4c12-915c-9e739dcb339c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:52.716012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a697ed1-d4ed-4c12-915c-9e739dcb339c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:52.716556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a697ed1-d4ed-4c12-915c-9e739dcb339c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:52.718656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 236/457] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:52 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:52.721918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea438ee-8a0d-45de-8178-5bba59376da6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:52.722477 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea438ee-8a0d-45de-8178-5bba59376da6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:52.723523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea438ee-8a0d-45de-8178-5bba59376da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:52.734757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf932d-6676-45e6-9a4c-8fcebc73d16b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:52.741134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf932d-6676-45e6-9a4c-8fcebc73d16b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:52.741759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf932d-6676-45e6-9a4c-8fcebc73d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:52.758708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5ea438ee-8a0d-45de-8178-5bba59376da6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:52.760273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5ea438ee-8a0d-45de-8178-5bba59376da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:52.773601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6dbf932d-6676-45e6-9a4c-8fcebc73d16b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:52.775104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6dbf932d-6676-45e6-9a4c-8fcebc73d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:52.811479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:52.889195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 237/458] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:52.912005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf932d-6676-45e6-9a4c-8fcebc73d16b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:52.913234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 222/459] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:52.937290 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea438ee-8a0d-45de-8178-5bba59376da6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:53.053866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf932d-6676-45e6-9a4c-8fcebc73d16b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:53.057372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea438ee-8a0d-45de-8178-5bba59376da6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:53.076503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:53.091198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9c0fd-4f1c-4767-8baa-3ead623dc51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:53.093167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c0fd-4f1c-4767-8baa-3ead623dc51c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.093167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c0fd-4f1c-4767-8baa-3ead623dc51c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.093167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c0fd-4f1c-4767-8baa-3ead623dc51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.098735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:53.099767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.100211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.100774 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.104808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9c0fd-4f1c-4767-8baa-3ead623dc51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:53.106275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9c0fd-4f1c-4767-8baa-3ead623dc51c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:53.113094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:53.115602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-66b9c0fd-4f1c-4767-8baa-3ead623dc51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:53.126737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:53.127855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:53.128940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:53.128940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:53.128940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:53.128940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:53.132631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 238/460] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:53.134063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a87e7-5b91-4dc9-b8ee-aca06c45b913 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.134352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a87e7-5b91-4dc9-b8ee-aca06c45b913 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.134641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a87e7-5b91-4dc9-b8ee-aca06c45b913 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.136155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 239/461] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:53.138829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:53.139818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:53.140868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:53.140868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:53.140868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:53.140868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:53.142033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dcd28-a9d6-4aed-8547-081344d63c69 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.142319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dcd28-a9d6-4aed-8547-081344d63c69 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.142602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dcd28-a9d6-4aed-8547-081344d63c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.143051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 223/462] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:53.144127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:53.154304 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:53.162257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-eb9dcd28-a9d6-4aed-8547-081344d63c69 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:53.163471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-eb9dcd28-a9d6-4aed-8547-081344d63c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:53.237933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 240/463] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:53.239086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dcd28-a9d6-4aed-8547-081344d63c69 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:53.264071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82fa91-a004-457b-94cc-db56fcd5ce07 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:53.303622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:53.304599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.305078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.305630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.306540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:53.307031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:53.308756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:53.322688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 224/464] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:53.323806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:53.356172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:53.375037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dcd28-a9d6-4aed-8547-081344d63c69 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:53.413284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:53.413952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.414233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.414506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.415223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:53.415527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:53.416948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:53.419511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:53.432352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 241/465] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:53.432352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:53.442356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4362d-9820-443a-98e9-8725a3440805 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:53.478159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70388f-86bc-42e9-8bb3-2ccd9dc4e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:53.478953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70388f-86bc-42e9-8bb3-2ccd9dc4e03c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.479239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70388f-86bc-42e9-8bb3-2ccd9dc4e03c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.479516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70388f-86bc-42e9-8bb3-2ccd9dc4e03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.491130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70388f-86bc-42e9-8bb3-2ccd9dc4e03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:53.492628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70388f-86bc-42e9-8bb3-2ccd9dc4e03c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3f70388f-86bc-42e9-8bb3-2ccd9dc4e03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:53.511164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:53.512162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:53.513715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:53.513715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:53.513715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:53.513715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:53.513715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 225/466] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:53.513978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b0f7d-e316-42b1-945f-f804712184e4 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.514231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b0f7d-e316-42b1-945f-f804712184e4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.514510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b0f7d-e316-42b1-945f-f804712184e4 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.520345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 226/467] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:53.520345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b0f7d-e316-42b1-945f-f804712184e4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:53.553867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fae882-8957-48de-9df1-2a4dca902b83 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:53.597847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96a2d3-376a-4e73-8c6f-40b6bf085f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:53.598644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a2d3-376a-4e73-8c6f-40b6bf085f6a None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.599018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a2d3-376a-4e73-8c6f-40b6bf085f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.599359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a2d3-376a-4e73-8c6f-40b6bf085f6a None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.600348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96a2d3-376a-4e73-8c6f-40b6bf085f6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:53.602142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96a2d3-376a-4e73-8c6f-40b6bf085f6a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:53.617466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:53.638888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b0f7d-e316-42b1-945f-f804712184e4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:53.673376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dac92a-cf8e-436f-9e1b-2a66c72c386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:53.674071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dac92a-cf8e-436f-9e1b-2a66c72c386c None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.674356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dac92a-cf8e-436f-9e1b-2a66c72c386c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.674627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dac92a-cf8e-436f-9e1b-2a66c72c386c None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.675355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dac92a-cf8e-436f-9e1b-2a66c72c386c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:53.677580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dac92a-cf8e-436f-9e1b-2a66c72c386c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:53.711932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 242/468] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:53 2022] POST /identity/v3/users => generated 249 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:53.713283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96a2d3-376a-4e73-8c6f-40b6bf085f6a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:53.778908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:53.792798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 227/469] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:53 2022] POST /identity/v3/users => generated 247 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:51:53.794990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36dc5-99a3-4a2e-a5ad-3b017b3ed27f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.795504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36dc5-99a3-4a2e-a5ad-3b017b3ed27f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.795989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd36dc5-99a3-4a2e-a5ad-3b017b3ed27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.841595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ebd36dc5-99a3-4a2e-a5ad-3b017b3ed27f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:53.843218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ebd36dc5-99a3-4a2e-a5ad-3b017b3ed27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:53.857529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96a2d3-376a-4e73-8c6f-40b6bf085f6a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:53.910023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:53.910933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:53.911254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:53.911650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:53.912594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:53.912987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:53.914923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:53.933614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 243/470] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:53.940219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:54.028276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 228/471] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:54.054215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd36dc5-99a3-4a2e-a5ad-3b017b3ed27f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:54.091080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3edb8-c544-4a36-8c9c-1f8f8fbfe33b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:54.147040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:54.178982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0fdb6-2867-4159-a9b8-325fd23faa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:54.180250 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fdb6-2867-4159-a9b8-325fd23faa3d None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:54.181055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fdb6-2867-4159-a9b8-325fd23faa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:54.181528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fdb6-2867-4159-a9b8-325fd23faa3d None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:54.182271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0fdb6-2867-4159-a9b8-325fd23faa3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:54.183726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:54.184966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0fdb6-2867-4159-a9b8-325fd23faa3d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:54.227978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd36dc5-99a3-4a2e-a5ad-3b017b3ed27f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:54.266240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:54.267034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:54.267332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:54.267609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:54.281306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:54.282853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:54.288511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 244/472] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:53 2022] POST /identity/v3/users => generated 249 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:51:54.290737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c9c3-b0f0-422b-aad5-dd7f01c820fe None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:54.291314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c9c3-b0f0-422b-aad5-dd7f01c820fe None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:54.291926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c9c3-b0f0-422b-aad5-dd7f01c820fe None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:54.298419 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 245/473] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:54 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:54.303319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:54.304613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:54.306223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:54.306223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:54.306223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:54.306223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:54.306223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 229/474] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:54.308484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318435-abf8-4732-a8ad-df9cddfafa70 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:54.320629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318435-abf8-4732-a8ad-df9cddfafa70 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:54.320629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318435-abf8-4732-a8ad-df9cddfafa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:54.320848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:54.332702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-49318435-abf8-4732-a8ad-df9cddfafa70 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:54.334584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-49318435-abf8-4732-a8ad-df9cddfafa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:54.432112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 246/475] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:54.449718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab2710-7d62-4a44-bb9d-468c068f7fd7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:54.453801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49318435-abf8-4732-a8ad-df9cddfafa70 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:54.472676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:54.501854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:54.502835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:54.503129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:54.503401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:54.505736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:54.506532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:54.508516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:54.524978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 230/476] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:54.530726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:54.637737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:54.647042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49318435-abf8-4732-a8ad-df9cddfafa70 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:54.673431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ad429-9ecd-4e42-985e-fbc6a2e1a01d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:54.686680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:54.686680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:54.686680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:54.686680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:54.687071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:54.688511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:54.719954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959feb5-f645-4300-a13f-39e92e8558fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:54.720860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959feb5-f645-4300-a13f-39e92e8558fc None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:54.721152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959feb5-f645-4300-a13f-39e92e8558fc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:54.721432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959feb5-f645-4300-a13f-39e92e8558fc None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:54.722193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959feb5-f645-4300-a13f-39e92e8558fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:54.723717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959feb5-f645-4300-a13f-39e92e8558fc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:54.736648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.sql.core [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 17:51:54.736648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 17:51:54.736648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [parameters: {'id': 'f18dbf6263854ffdaee9b6d59cdd88ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 17:51:54.736648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80357) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application conn.query(q) May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result.read() May 26 17:51:54.755752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return ref.to_dict() May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:51:54.757160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application next(self.gen) May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application yield resource May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application next(self.gen) May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.session.rollback() May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.force_reraise() May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise self.value May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application session.commit() May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 17:51:54.758959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._prepare_impl() May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.session.flush() May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._flush(objects) May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application compat.raise_( May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application flush_context.execute() May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rec.execute(self) May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 17:51:54.760869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:51:54.763850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application conn.query(q) May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result.read() May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:51:54.767069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [parameters: {'id': 'f18dbf6263854ffdaee9b6d59cdd88ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:54.769609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 17:51:54.772626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:54.779743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 247/477] 10.222.0.123 () {60 vars in 1136 bytes} [Thu May 26 17:51:54 2022] POST /identity/v3/roles => generated 144 bytes in 304 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:54.779743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:54.806123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 231/478] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:51:54 2022] POST /identity/v3/users => generated 250 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:51:54.901807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f86e5-6467-45b0-bb03-169998690a87 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:54.943175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce3044-2ee4-4cc3-8e27-7f9dedbc8b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:54.943919 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce3044-2ee4-4cc3-8e27-7f9dedbc8b63 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:54.944204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce3044-2ee4-4cc3-8e27-7f9dedbc8b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:54.944510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce3044-2ee4-4cc3-8e27-7f9dedbc8b63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:54.956166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce3044-2ee4-4cc3-8e27-7f9dedbc8b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e9ce3044-2ee4-4cc3-8e27-7f9dedbc8b63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:54.965180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:54.966118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:54.966918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 248/479] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:51:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:51:54.972518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959feb5-f645-4300-a13f-39e92e8558fc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:55.010381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:55.100138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959feb5-f645-4300-a13f-39e92e8558fc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:55.210922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad218f6-0e88-4aef-bcbc-6714925d3087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:55.211556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad218f6-0e88-4aef-bcbc-6714925d3087 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:55.211866 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad218f6-0e88-4aef-bcbc-6714925d3087 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:55.212154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad218f6-0e88-4aef-bcbc-6714925d3087 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:55.213024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad218f6-0e88-4aef-bcbc-6714925d3087 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:55.213385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad218f6-0e88-4aef-bcbc-6714925d3087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:55.214981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad218f6-0e88-4aef-bcbc-6714925d3087 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:55.232004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 232/480] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:51:54 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:56.745433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec39a3-85fd-44db-9e94-16cf21013732 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:56.746039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec39a3-85fd-44db-9e94-16cf21013732 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:56.746039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec39a3-85fd-44db-9e94-16cf21013732 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:56.747632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 249/481] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:56.752082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531361d-e68c-4f29-b673-65a243444222 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:56.752594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531361d-e68c-4f29-b673-65a243444222 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:56.752667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ec2f-6a93-421e-8371-157e8a840a27 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:56.752735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531361d-e68c-4f29-b673-65a243444222 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:56.752971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ec2f-6a93-421e-8371-157e8a840a27 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:56.753155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ec2f-6a93-421e-8371-157e8a840a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:56.754023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 233/482] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:56.765355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5a4f-842a-4650-8e48-76a7620c0f80 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:56.765635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5a4f-842a-4650-8e48-76a7620c0f80 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:56.765904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b5a4f-842a-4650-8e48-76a7620c0f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:56.779902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b7f3ec2f-6a93-421e-8371-157e8a840a27 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:56.781099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b7f3ec2f-6a93-421e-8371-157e8a840a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:56.803829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0e0b5a4f-842a-4650-8e48-76a7620c0f80 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:56.805026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0e0b5a4f-842a-4650-8e48-76a7620c0f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:56.818237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:56.920945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 250/483] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:56.937488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 234/484] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:51:56.983083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3ec2f-6a93-421e-8371-157e8a840a27 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:56.992902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5a4f-842a-4650-8e48-76a7620c0f80 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:57.061348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:57.171874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3ec2f-6a93-421e-8371-157e8a840a27 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:57.182018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b5a4f-842a-4650-8e48-76a7620c0f80 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:57.220804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6e3f3-cc09-44fa-8beb-248e8e6a333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:57.221599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6e3f3-cc09-44fa-8beb-248e8e6a333c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.221875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6e3f3-cc09-44fa-8beb-248e8e6a333c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.222143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6e3f3-cc09-44fa-8beb-248e8e6a333c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.238321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2de4d-a419-4642-989d-1d933355f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:57.239258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2de4d-a419-4642-989d-1d933355f942 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.239536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2de4d-a419-4642-989d-1d933355f942 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.239803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2de4d-a419-4642-989d-1d933355f942 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.245355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6e3f3-cc09-44fa-8beb-248e8e6a333c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-dbb6e3f3-cc09-44fa-8beb-248e8e6a333c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:57.256850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:57.257756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:57.259049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 235/485] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:51:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:57.266759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2de4d-a419-4642-989d-1d933355f942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:57.273348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6e3f3-cc09-44fa-8beb-248e8e6a333c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-23a2de4d-a419-4642-989d-1d933355f942 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:57.277705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:57.278827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:51:57.279809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:57.281866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 251/486] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:51:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:57.288582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2de4d-a419-4642-989d-1d933355f942 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:57.335927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:57.421116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2de4d-a419-4642-989d-1d933355f942 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:57.423906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:57.463384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6e3f3-cc09-44fa-8beb-248e8e6a333c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:57.501627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868bfe-c2aa-4c4d-9e9e-f1c010501746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:57.502868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868bfe-c2aa-4c4d-9e9e-f1c010501746 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.503167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868bfe-c2aa-4c4d-9e9e-f1c010501746 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.503450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868bfe-c2aa-4c4d-9e9e-f1c010501746 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.504826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868bfe-c2aa-4c4d-9e9e-f1c010501746 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:57.505141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868bfe-c2aa-4c4d-9e9e-f1c010501746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:57.507595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868bfe-c2aa-4c4d-9e9e-f1c010501746 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:57.519383 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 252/487] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:51:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:57.520980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18b40a-982c-403a-a8f0-1b5243933920 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.521277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18b40a-982c-403a-a8f0-1b5243933920 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.521560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18b40a-982c-403a-a8f0-1b5243933920 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.522968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 253/488] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:57.523907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:57.524781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.525064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.525363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.526228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:57.527764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:57.529032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27c0d-d098-44ef-986b-5ee5d2e51e94 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.529324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:57.529490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27c0d-d098-44ef-986b-5ee5d2e51e94 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.529644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27c0d-d098-44ef-986b-5ee5d2e51e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.544401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 236/489] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:51:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:57.545314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:57.555232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6ca27c0d-d098-44ef-986b-5ee5d2e51e94 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:57.556515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6ca27c0d-d098-44ef-986b-5ee5d2e51e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:57.639405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 254/490] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:57.640389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27c0d-d098-44ef-986b-5ee5d2e51e94 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:57.644752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:57.697241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816cba8-fb5f-4847-a66a-c649b095132a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:57.739858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4fad-8e55-4495-86ae-c09a614a31c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:57.740871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4fad-8e55-4495-86ae-c09a614a31c7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.741165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4fad-8e55-4495-86ae-c09a614a31c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.741475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4fad-8e55-4495-86ae-c09a614a31c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.749975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27c0d-d098-44ef-986b-5ee5d2e51e94 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:57.753440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf4fad-8e55-4495-86ae-c09a614a31c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:57.755563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf4fad-8e55-4495-86ae-c09a614a31c7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:57.764730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-9cdf4fad-8e55-4495-86ae-c09a614a31c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:57.774862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:57.779081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 237/491] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c0fb-26dd-4582-a066-bf31bc08ae69 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c0fb-26dd-4582-a066-bf31bc08ae69 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c0fb-26dd-4582-a066-bf31bc08ae69 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.786654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 238/492] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:57 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:57.787219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5c0fb-26dd-4582-a066-bf31bc08ae69 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:57.805733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:57.806875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.807211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.807408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.820866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:57.822375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:57.842239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:57.843273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:57.844221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:57.844221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:57.844221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:57.844221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:57.844221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 255/493] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:57.844221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:57.906536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5c0fb-26dd-4582-a066-bf31bc08ae69 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:57.913409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:57.946625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061a1f-1c75-4e2a-b449-ee9c8435382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:57.947507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061a1f-1c75-4e2a-b449-ee9c8435382a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.947798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061a1f-1c75-4e2a-b449-ee9c8435382a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.948081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061a1f-1c75-4e2a-b449-ee9c8435382a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.960382 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31061a1f-1c75-4e2a-b449-ee9c8435382a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:57.961871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a43b-17a9-4459-a6a9-0c2d0672a055 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-31061a1f-1c75-4e2a-b449-ee9c8435382a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:57.970808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:57.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 239/494] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:57.978010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72f1b-82ab-455d-8425-20110b412c4b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.978751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72f1b-82ab-455d-8425-20110b412c4b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:57.978751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a72f1b-82ab-455d-8425-20110b412c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:57.996054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d2a72f1b-82ab-455d-8425-20110b412c4b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:57.997270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d2a72f1b-82ab-455d-8425-20110b412c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:57.998945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:57.999679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:57.999967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.001017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.001017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:58.001320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.002647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.016171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 256/495] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:58.017032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.067530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:58.080448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 240/496] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:58.081351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a72f1b-82ab-455d-8425-20110b412c4b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.144541 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c07cbb-4fb1-4230-9a74-db0100093623 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.162102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:58.183616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.184533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.185218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.185218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.186035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:58.186459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.188233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.212036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 257/497] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:58.212036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.219008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a72f1b-82ab-455d-8425-20110b412c4b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.261074 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.261742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.262030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.262301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.263053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:58.263359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.264874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.273565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 241/498] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:58.274373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.329425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641c594-d7a5-4124-bd43-bd09fb7a9792 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.330876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:58.364888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.365673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.365950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.366218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.373422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.374872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.378520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6ce55-ae19-4e00-825a-e89492ee74ee None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:51:58.391143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:58.392245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 258/499] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:58.393373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.416990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de986f-0b20-4a12-bfd2-9de698926552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.417811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de986f-0b20-4a12-bfd2-9de698926552 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.418139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de986f-0b20-4a12-bfd2-9de698926552 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.418443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de986f-0b20-4a12-bfd2-9de698926552 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.429714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de986f-0b20-4a12-bfd2-9de698926552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:51:58.430003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b2de986f-0b20-4a12-bfd2-9de698926552 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:51:58.438358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:58.443252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 242/500] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:58.444177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605a3d2-39e7-407a-814d-e6271806d723 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.445128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605a3d2-39e7-407a-814d-e6271806d723 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.445128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605a3d2-39e7-407a-814d-e6271806d723 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.445128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 243/501] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:51:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:51:58.445128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605a3d2-39e7-407a-814d-e6271806d723 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.505521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535d6b0-7582-4a4c-a0ca-885d6c16dd39 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.546677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605a3d2-39e7-407a-814d-e6271806d723 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.548466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.549256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.549552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.549804 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.558120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.559567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.560217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:51:58.574674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:58.575652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 259/502] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:58.576647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.585203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.585995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.586268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.586543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.597705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.599981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:58.618344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:58.619386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:58.620270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:58.620270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:58.620270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:58.620270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:58.620270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 244/503] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:58.620585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.676694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:58.682636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9556c98-520a-46e2-9b2c-2f2c285cbc8a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.718605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fbd0f-a2bc-44c5-8749-9d1724012bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.719265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbd0f-a2bc-44c5-8749-9d1724012bdd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.719542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbd0f-a2bc-44c5-8749-9d1724012bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.719813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbd0f-a2bc-44c5-8749-9d1724012bdd None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.720667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fbd0f-a2bc-44c5-8749-9d1724012bdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:58.720975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fbd0f-a2bc-44c5-8749-9d1724012bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.722750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fbd0f-a2bc-44c5-8749-9d1724012bdd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.724033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364d95e-3d6c-4f94-995b-93d0de07d046 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.757652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.758326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.758580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.758851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.759593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:58.759901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.761317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 260/504] 10.222.0.123 () {56 vars in 1142 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:58.761735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.762724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9791d2-b9ec-453c-a2f4-42bd99e80f7a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.763042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9791d2-b9ec-453c-a2f4-42bd99e80f7a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.763320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9791d2-b9ec-453c-a2f4-42bd99e80f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.770880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 245/505] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:58.771805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.780720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4d9791d2-b9ec-453c-a2f4-42bd99e80f7a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:51:58.781908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4d9791d2-b9ec-453c-a2f4-42bd99e80f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:51:58.802303 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:58.857619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 261/506] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:51:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:51:58.858474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9791d2-b9ec-453c-a2f4-42bd99e80f7a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.881090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357f99-898b-42dd-a3d8-a3dda737afb8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:58.915565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:58.916624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:58.917030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:58.917438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:58.918707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:58.919017 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:58.920521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:58.951240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:58.960774 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 246/507] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:58.961626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:58.968589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9791d2-b9ec-453c-a2f4-42bd99e80f7a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.006586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.007239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.007515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.008072 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.008825 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:59.009150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.010498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.023008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 262/508] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:59.023637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.051841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:59.069017 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb3137-00b3-4238-a6cc-d848fc3fa12e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.104193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26e83-b8f8-4124-9cd7-d8366c71ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.104881 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26e83-b8f8-4124-9cd7-d8366c71ca59 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.105162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26e83-b8f8-4124-9cd7-d8366c71ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.105441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26e83-b8f8-4124-9cd7-d8366c71ca59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.182834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a92e-6fbf-471c-a329-07a7cd709973 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.215509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26e83-b8f8-4124-9cd7-d8366c71ca59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.216970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26e83-b8f8-4124-9cd7-d8366c71ca59 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.217480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.218354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.218679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.218973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.230952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.232453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.234967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:59.250674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:59.251547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:59.252613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:59.252613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:59.252613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:59.252613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:59.252613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 263/509] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:59.253162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.311317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:59.327887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 247/510] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:59.328743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26e83-b8f8-4124-9cd7-d8366c71ca59 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.364493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911794a9-24e8-4f39-9ad3-b84dbdfcfe0d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.398335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.399122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.399401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.399672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.413692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.415147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.431761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26e83-b8f8-4124-9cd7-d8366c71ca59 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:59.433718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:59.434783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:59.435819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:59.435819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:59.435819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:59.435819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:59.435819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 264/511] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:59.436189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.467612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58dbf-03e2-4eb8-897e-ed402421efeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.468167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58dbf-03e2-4eb8-897e-ed402421efeb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.468475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58dbf-03e2-4eb8-897e-ed402421efeb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.468752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58dbf-03e2-4eb8-897e-ed402421efeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.491908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:59.521534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:59.537205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d58dbf-03e2-4eb8-897e-ed402421efeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.538691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d58dbf-03e2-4eb8-897e-ed402421efeb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.544850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8f5d2-ae31-4439-9077-b4caf0bf2c16 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.585811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.586999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.587398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.587817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.600291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.602583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:51:59.621776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:59.622852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:51:59.623719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 265/512] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:59.624268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.652669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 248/513] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:51:59.653638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58dbf-03e2-4eb8-897e-ed402421efeb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.740214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:59.744788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a421-8454-4338-81e7-dba67cbbdfa3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.755700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:59.757101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58dbf-03e2-4eb8-897e-ed402421efeb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.783179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.784027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.784432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.784778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.785759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:59.785971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.787540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.794679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.795440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.795631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.795988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.801344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 266/514] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:59.802314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.809495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.810976 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:51:59.829126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:51:59.829989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:51:59.830827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:51:59.830827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:51:59.830827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:51:59.830827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:51:59.830827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 249/515] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:51:59.831519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.916262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f87180-8205-4e9f-be3c-3e30be0eee86 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.943872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b397840-387f-40f5-93c6-2bdef497d818 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:51:59.955874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.956643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.956970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.957275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.958665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:59.958979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.960513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.974043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 267/516] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:51:59.974966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:51:59.980906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:51:59.981572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:51:59.981852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:51:59.982135 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:51:59.982970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:51:59.983276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:51:59.984753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:51:59.987478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:00.003066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 250/517] 10.222.0.123 () {56 vars in 1142 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:00.003808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.008110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:00.084340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98922e-4753-4e4f-96b5-05596f98509c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.110170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea2a31-3f44-4e41-8eee-b0871eb779d1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.118397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.119189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.119724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.119885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.131145 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.132617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:00.145903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.146698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.146981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.147255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:00.150698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:00.151647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:00.152834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:00.152834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:00.152834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:00.152834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:00.154649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.156098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:00.156353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 268/518] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:00.157324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:00.172984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:00.174217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 251/519] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:00.175561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.231489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:00.249269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:00.269499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723bf94-04a2-469d-b173-9e00b742e348 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.277498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eba84f-ec5f-4350-8d84-6820c8c2f714 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.306746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.307419 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.307702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.307980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.308728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:00.309035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.310415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:00.315047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa6c8b-104b-43f2-8bf1-cb9950ec6264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.315757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa6c8b-104b-43f2-8bf1-cb9950ec6264 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.316077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa6c8b-104b-43f2-8bf1-cb9950ec6264 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.316391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa6c8b-104b-43f2-8bf1-cb9950ec6264 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.317769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa6c8b-104b-43f2-8bf1-cb9950ec6264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.319218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa6c8b-104b-43f2-8bf1-cb9950ec6264 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:00.323278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 269/520] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:00.324102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.401890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 252/521] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:52:00 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:00.417377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa6c8b-104b-43f2-8bf1-cb9950ec6264 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.431576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf72d-a7d1-4f2a-8c0c-1aea2b750b50 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.475239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aa1c8-a7b5-45aa-8935-0eb59cac86e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.475915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aa1c8-a7b5-45aa-8935-0eb59cac86e3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.476200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aa1c8-a7b5-45aa-8935-0eb59cac86e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.476503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aa1c8-a7b5-45aa-8935-0eb59cac86e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.489761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:00.551149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa6c8b-104b-43f2-8bf1-cb9950ec6264 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.564579 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aa1c8-a7b5-45aa-8935-0eb59cac86e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.565202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:00.566102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aa1c8-a7b5-45aa-8935-0eb59cac86e3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:00.594535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.595357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.595689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.596129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.596893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:00.597207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.599275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:00.614456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 253/522] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:00.618310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.688977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 270/523] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:00.694874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aa1c8-a7b5-45aa-8935-0eb59cac86e3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.744925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:00.747621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec2797-4c9f-43b5-a4ae-b43a7d87080e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.793180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.794061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.794528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.794963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.796733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:00.797159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.798661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:00.811084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aa1c8-a7b5-45aa-8935-0eb59cac86e3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.818262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 254/524] 10.222.0.123 () {56 vars in 1144 bytes} [Thu May 26 17:52:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:00.818932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.855347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.856147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.856453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:00.856555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.856739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.865985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.869122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:00.885148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:00.886154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 271/525] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:00.891822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:00.938084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395c387-23ac-4ffb-8bdc-18aa047faa4f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:00.977402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:00.978310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:00.978684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:00.978972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:00.986379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:00.987847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:01.003084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:01.003977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:01.005274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 255/526] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:01.005727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:01.017063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:01.020379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aecd5-7bec-40a3-a425-9ce8de34d46c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:01.059941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:01.060768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:01.061050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:01.061373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:01.073049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:01.074507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:01.094858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:01.095929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:01.097468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:01.097468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:01.097468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:01.097468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:01.097468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 272/527] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:01.097468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:01.121610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:01.135056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a026bad-e279-435d-8b06-933890bced46 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:01.175001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba39167-80f9-457f-9f11-85b7f1d1aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:01.175759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39167-80f9-457f-9f11-85b7f1d1aecf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:01.176132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39167-80f9-457f-9f11-85b7f1d1aecf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:01.177119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39167-80f9-457f-9f11-85b7f1d1aecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:01.218162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fc01-e978-44d5-99d5-ad7a88dd0002 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:01.253064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba39167-80f9-457f-9f11-85b7f1d1aecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:01.256119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba39167-80f9-457f-9f11-85b7f1d1aecf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.258507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:01.260027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:01.260331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:01.260689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:01.261479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:01.261793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:01.263225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.287391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 273/528] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:01.288575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:01.304920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:01.368450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:01.384731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 256/529] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:01.385908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba39167-80f9-457f-9f11-85b7f1d1aecf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:01.406776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1005c3c-0589-4105-b78c-915e44859ebc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:01.447680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:01.448366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:01.448654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:01.448937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:01.449829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:01.450223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:01.451623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.471302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 274/530] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:01.471302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:01.501582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba39167-80f9-457f-9f11-85b7f1d1aecf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:01.543608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:01.544315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:01.544683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:01.544960 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:01.545757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:01.546070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:01.547032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:01.547687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.568830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 257/531] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:01.568830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:01.593948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdc34a-84b0-4300-974f-f4762d2a7597 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:01.632427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:01.639204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:01.639934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:01.640209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:01.640548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:01.641421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=43a2c87f8db748ba9264b141f059aab9) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:01.641866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:01.643306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.651720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 275/532] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/role_assignments?user.id=43a2c87f8db748ba9264b141f059aab9&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:01.652625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:01.711208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd1a5c-202e-470f-9cba-3c5fb0b7afb0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:01.752550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:01.753452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:01.753732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:01.754006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:01.766939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:01.768699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:01.797766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:01.799444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:01.800674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:01.800674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:01.800674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:01.800674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:01.803602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 258/533] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:01.804790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:01.808712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f189e-3ab1-4482-9819-9d3594e40f81 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:01.849987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:01.850690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:01.851033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:01.851325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:01.852148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=6fd75bf129c642a89153efcb584406d8) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:01.852493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:01.853928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:01.857616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:01.864754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 276/534] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/role_assignments?user.id=6fd75bf129c642a89153efcb584406d8&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:01.866273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:02.029550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de1ee-c4f9-42cb-abec-84177f4a1bee None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:02.037196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:02.041838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474997e5-db40-4f5c-b878-61507aaf3f8a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:02.072411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:02.073155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.073474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.073776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.074633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:02.074953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:02.076644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:02.091727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 277/535] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:02.099395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:02.157593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:02.158391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.158668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.158936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.167461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:02.168967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:02.184715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:02.189719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:02.190536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:02.191585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 259/536] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:02.197033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:02.233214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186bdfe-3a1f-49c3-a9c0-13fd27a10d05 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:02.275182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:02.275999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.276287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.276590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.287022 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:02.287022 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:02.303184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:02.304181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:02.305269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:02.305269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:02.305269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:02.305269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:02.305269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:02.305269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:02.305269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:02.305269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:02.307147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 278/537] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:02.312941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:02.463867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78185b0b-c637-4055-9d02-b860b20e0a38 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:02.515657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150c8c-2e1d-468a-a6b7-23562c794a54 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:02.544794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:02.561073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:02.561833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.562145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.562452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.563368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:02.563709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:02.565434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:02.571566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:02.572387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.572713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.573033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.573963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:02.574322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:02.576020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:02.594278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 279/538] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:02.604365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:02.617720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 260/539] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:02.623175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:02.664677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:02.812679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e61649-4644-4c52-8f0e-8a53501d3fb5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:02.814350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9659bb-4ea8-4a56-ad27-77c28d36eb5b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:02.853709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8babb-97a7-4f2b-a619-46b6725ecac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:02.854443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8babb-97a7-4f2b-a619-46b6725ecac4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.854755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8babb-97a7-4f2b-a619-46b6725ecac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.855077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8babb-97a7-4f2b-a619-46b6725ecac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.856019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8babb-97a7-4f2b-a619-46b6725ecac4 None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=425574d1c0a04fb29452e7f7d0b7d685) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:02.856423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8babb-97a7-4f2b-a619-46b6725ecac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:02.858048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8babb-97a7-4f2b-a619-46b6725ecac4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:02.862180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:02.863138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.863426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.863749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.864831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=66452133fd6348109e3065303947ecce) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:02.865153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:02.865656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 261/540] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:02 2022] GET /identity/v3/role_assignments?user.id=425574d1c0a04fb29452e7f7d0b7d685&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:02.866604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:02.867130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a9e9a-678d-4635-a441-bb02717a70d6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.867531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a9e9a-678d-4635-a441-bb02717a70d6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.867905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a9e9a-678d-4635-a441-bb02717a70d6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.869521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 262/541] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:02.886257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10bf0-0b78-4588-aa26-a1aebb0071a4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:02.886550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10bf0-0b78-4588-aa26-a1aebb0071a4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:02.886823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10bf0-0b78-4588-aa26-a1aebb0071a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:02.888649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 280/542] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:02 2022] GET /identity/v3/role_assignments?user.id=66452133fd6348109e3065303947ecce&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:02.929620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-20b10bf0-0b78-4588-aa26-a1aebb0071a4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:02.930929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-20b10bf0-0b78-4588-aa26-a1aebb0071a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:03.024791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 263/543] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:03.056260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:03.169543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:03.247253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0048db-21e0-4afc-833c-26fdf587ab10 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:03.314632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95788886-fa1e-42a1-8b34-418280ab36bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:03.315534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95788886-fa1e-42a1-8b34-418280ab36bf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:03.315889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95788886-fa1e-42a1-8b34-418280ab36bf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:03.316169 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95788886-fa1e-42a1-8b34-418280ab36bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:03.338615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95788886-fa1e-42a1-8b34-418280ab36bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-95788886-fa1e-42a1-8b34-418280ab36bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:03.347142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:03.348013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:03.349671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 281/544] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:03.354826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10bf0-0b78-4588-aa26-a1aebb0071a4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:03.376427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:03.468512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10bf0-0b78-4588-aa26-a1aebb0071a4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:03.505617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:03.506631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:03.507109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:03.507579 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:03.508554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:03.509098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:03.510683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:03.519861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 264/545] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:03.525810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95788886-fa1e-42a1-8b34-418280ab36bf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:03.681582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95788886-fa1e-42a1-8b34-418280ab36bf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:03.684437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:03.728010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:03.728757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:03.729041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:03.729321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:03.744725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:03.746199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:03.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:03.772146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:03.774431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:03.774431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:03.774431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:03.774431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:03.778543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 282/546] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:03.778753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:03.893789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:03.930303 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06a213-e10a-4c0f-ab40-8ed4d2e6a48e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:03.969121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:03.969784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:03.970067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:03.970343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:03.971070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:03.971375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:03.972780 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:03.986521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 265/547] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:03.997686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:04.128063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045b640-baa4-4e13-ba0f-5bb2986d3586 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:04.166239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:04.167064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:04.167346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:04.167622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:04.176638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:04.178223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:04.197373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:04.199061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:04.200228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 283/548] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:04.205151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:04.363634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ae4a-fd90-44ed-8371-35c0fde32740 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:04.415810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528aef6-4d52-40c7-a6e7-359490fc8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:04.416923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528aef6-4d52-40c7-a6e7-359490fc8f35 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:04.417496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528aef6-4d52-40c7-a6e7-359490fc8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:04.417971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528aef6-4d52-40c7-a6e7-359490fc8f35 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:04.419018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528aef6-4d52-40c7-a6e7-359490fc8f35 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:04.419519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528aef6-4d52-40c7-a6e7-359490fc8f35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:04.421328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528aef6-4d52-40c7-a6e7-359490fc8f35 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:04.424529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:04.446924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 266/549] 10.222.0.123 () {56 vars in 1140 bytes} [Thu May 26 17:52:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:04.452218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:04.459663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda469a-31f1-49e1-a4b4-60d6ef044b23 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:04.459955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda469a-31f1-49e1-a4b4-60d6ef044b23 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:04.460211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda469a-31f1-49e1-a4b4-60d6ef044b23 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:04.461911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 267/550] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:04.470835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36181-8c30-4daf-bb78-5b3ef898b4e5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:04.471219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36181-8c30-4daf-bb78-5b3ef898b4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:04.471542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36181-8c30-4daf-bb78-5b3ef898b4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:04.489545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:04.510822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1da36181-8c30-4daf-bb78-5b3ef898b4e5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:04.512017 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1da36181-8c30-4daf-bb78-5b3ef898b4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:04.648727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 268/551] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:04.671742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fac43a-470f-492e-a726-fae6adc03554 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:04.685674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26770-f648-4f31-9bd9-72fdd0376dfb None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:04.685990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26770-f648-4f31-9bd9-72fdd0376dfb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:04.686231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26770-f648-4f31-9bd9-72fdd0376dfb None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:04.687584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 269/552] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:04.694185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c303bc-0624-4b4d-a78d-dea6d63192c6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:04.694472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c303bc-0624-4b4d-a78d-dea6d63192c6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:04.694972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c303bc-0624-4b4d-a78d-dea6d63192c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:04.715001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-66c303bc-0624-4b4d-a78d-dea6d63192c6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:04.716191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-66c303bc-0624-4b4d-a78d-dea6d63192c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:04.719594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2375a-4e45-4970-8cc8-91e93c9ae3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:04.720486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2375a-4e45-4970-8cc8-91e93c9ae3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:04.720976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2375a-4e45-4970-8cc8-91e93c9ae3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:04.721430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2375a-4e45-4970-8cc8-91e93c9ae3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:04.808638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 270/553] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:52:04.808638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c303bc-0624-4b4d-a78d-dea6d63192c6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:04.825480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2375a-4e45-4970-8cc8-91e93c9ae3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:04.827342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2375a-4e45-4970-8cc8-91e93c9ae3b8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:04.848729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:04.886830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:04.938936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c303bc-0624-4b4d-a78d-dea6d63192c6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:04.943386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 284/554] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:04.944882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2375a-4e45-4970-8cc8-91e93c9ae3b8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:04.982696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cf6d0-2a02-4dd6-804c-b122ee92019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:04.983878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cf6d0-2a02-4dd6-804c-b122ee92019d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:04.984420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cf6d0-2a02-4dd6-804c-b122ee92019d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:04.984900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cf6d0-2a02-4dd6-804c-b122ee92019d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:04.996769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cf6d0-2a02-4dd6-804c-b122ee92019d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-cc2cf6d0-2a02-4dd6-804c-b122ee92019d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:05.006351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:05.007265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:05.008058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:05.010911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 271/555] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:05.012030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cf6d0-2a02-4dd6-804c-b122ee92019d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.057901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2375a-4e45-4970-8cc8-91e93c9ae3b8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.076826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:05.096153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ea4d8-9cf9-4ec1-857e-7d92c3430c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.097000 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea4d8-9cf9-4ec1-857e-7d92c3430c12 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.097277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea4d8-9cf9-4ec1-857e-7d92c3430c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.097781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ea4d8-9cf9-4ec1-857e-7d92c3430c12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.110369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ea4d8-9cf9-4ec1-857e-7d92c3430c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c45ea4d8-9cf9-4ec1-857e-7d92c3430c12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:05.119121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:05.120130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:05.120960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 285/556] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:05.121619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ea4d8-9cf9-4ec1-857e-7d92c3430c12 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.136334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cf6d0-2a02-4dd6-804c-b122ee92019d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.154988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:05.180634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.182044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.182541 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.183006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.198778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.200759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:05.223879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:05.225334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:05.226298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:05.226298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:05.226298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:05.226298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:05.229253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 272/557] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:05.230450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.256033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ea4d8-9cf9-4ec1-857e-7d92c3430c12 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.292875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.294498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.294975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.295463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.296553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:05.297058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.298852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.315512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 286/558] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:05.316728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.347179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b5759-73b3-4664-91f5-dd82538eaed9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.361699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:05.386455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.387461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.387891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.388327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.389221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:05.389707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.392389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.406535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 273/559] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:05.407707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.429306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fdf6-744d-45ee-bbdf-c9cff4d12be6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.438880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:05.466928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.467940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.468430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.468875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.469759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:05.470234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.472706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.486213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 287/560] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:05.487341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.528524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310d231-b302-4f4f-97d8-9d6f3c43a684 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.585624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.586777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.587174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.587559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.609236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.611459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.621058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:05.625374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47bdc9-0b93-43e3-8cde-809c1bac889b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:05.635752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:05.637610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:05.638504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:05.638504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:05.638504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:05.638504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:05.639896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 274/561] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:05.640905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.670394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.671557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.671921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.672250 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.687848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.689459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:05.715820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:05.716806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:05.717704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:05.717704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:05.717704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:05.717704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:05.722112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 288/562] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:05.723066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.743065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:05.765818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ee8c4-9570-4b4c-af43-853c64753b83 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.800088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.800917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.801198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.801522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.808139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.809634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:05.824835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:05.825816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:05.826705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 275/563] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:05.827172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.837310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c84f4-5fac-475a-a0fd-b9f527cdbc43 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.883638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f445ab-cb5b-499a-a41c-d924a4b50849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.884332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f445ab-cb5b-499a-a41c-d924a4b50849 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.884622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f445ab-cb5b-499a-a41c-d924a4b50849 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.884900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f445ab-cb5b-499a-a41c-d924a4b50849 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.885636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f445ab-cb5b-499a-a41c-d924a4b50849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:05.885932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f445ab-cb5b-499a-a41c-d924a4b50849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.887315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f445ab-cb5b-499a-a41c-d924a4b50849 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.899347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 289/564] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:05.900499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb05327-46a3-41be-b392-d79408d9a6b9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.900789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb05327-46a3-41be-b392-d79408d9a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.901065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb05327-46a3-41be-b392-d79408d9a6b9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.902289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 290/565] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:05.903344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ee2b6-4114-4e04-971d-9d6a0cfe6d45 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.903730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ee2b6-4114-4e04-971d-9d6a0cfe6d45 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.903902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ee2b6-4114-4e04-971d-9d6a0cfe6d45 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.905142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 291/566] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:05 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:05.905839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ee2b6-4114-4e04-971d-9d6a0cfe6d45 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:05.919949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:05.950769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8ae4-ca4a-4f22-b670-b41d260b01c6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:05.985072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:05.985653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:05.985935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:05.986212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:05.986931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:05.987239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:05.988643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:05.997040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:06.000252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 276/567] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:06.001067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.015761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ee2b6-4114-4e04-971d-9d6a0cfe6d45 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.050185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388b644-9146-4d24-a468-2aaac9283858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.050841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388b644-9146-4d24-a468-2aaac9283858 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.051412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388b644-9146-4d24-a468-2aaac9283858 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.051556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388b644-9146-4d24-a468-2aaac9283858 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.052503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388b644-9146-4d24-a468-2aaac9283858 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:06.052813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388b644-9146-4d24-a468-2aaac9283858 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:06.054243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388b644-9146-4d24-a468-2aaac9283858 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:06.066008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 292/568] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:06.068488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ba8cc-eb57-45f6-963b-51d2233176d9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.068780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ba8cc-eb57-45f6-963b-51d2233176d9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.069060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ba8cc-eb57-45f6-963b-51d2233176d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.085585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-303ba8cc-eb57-45f6-963b-51d2233176d9 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:06.086786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-303ba8cc-eb57-45f6-963b-51d2233176d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:06.106228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d028-9364-411f-9119-2c3b1be2a2c4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.140811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.141601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.141886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.142173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.150527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:06.151897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:06.152072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:06.157204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 293/569] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:06.158664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c33d-f595-492e-8a96-cf3eea140334 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.159143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c33d-f595-492e-8a96-cf3eea140334 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.159467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226c33d-f595-492e-8a96-cf3eea140334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:06.170842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:06.171981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 277/570] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:06.184782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.185600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4226c33d-f595-492e-8a96-cf3eea140334 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:06.185600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4226c33d-f595-492e-8a96-cf3eea140334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:06.237491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:06.249764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 294/571] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:06.250607 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226c33d-f595-492e-8a96-cf3eea140334 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.281263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182b8c9-2201-47b5-a2a0-76c844e9b0f5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.321831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.322626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.322907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.323184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.330795 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:06.332257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:06.346505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:06.348270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 278/572] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:06.350211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.366520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226c33d-f595-492e-8a96-cf3eea140334 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.396515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:06.402698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.403368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.403643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.403917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.404785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=a2fbee9630954680bcec917996319e3a) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:06.409277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:06.409277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:06.412116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 295/573] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/role_assignments?user.id=a2fbee9630954680bcec917996319e3a&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:06.412938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.463276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65daca8-8088-44b4-b17c-65a22c04fc86 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.495558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:06.511040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.511713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.512000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.512281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.513152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:06.513465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:06.514942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:06.539238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 279/574] 10.222.0.123 () {56 vars in 1142 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:06.540091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.551101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b73280-1aa9-42a0-80a1-91bc7adceacd None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.595479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73262-d5bb-42f0-97f2-95932b7a0d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.596646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73262-d5bb-42f0-97f2-95932b7a0d14 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.597129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73262-d5bb-42f0-97f2-95932b7a0d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.597393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73262-d5bb-42f0-97f2-95932b7a0d14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.615098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb73262-d5bb-42f0-97f2-95932b7a0d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ffb73262-d5bb-42f0-97f2-95932b7a0d14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:06.623048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:06.625660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 296/575] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:06.627190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73262-d5bb-42f0-97f2-95932b7a0d14 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.671053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac625c5-7454-4db5-b642-3146f445e8e9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.699021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:06.710905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fc8b-bec1-4606-a3a3-f3eaf605856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.711689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fc8b-bec1-4606-a3a3-f3eaf605856d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.711966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fc8b-bec1-4606-a3a3-f3eaf605856d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.712241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fc8b-bec1-4606-a3a3-f3eaf605856d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.724343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1fc8b-bec1-4606-a3a3-f3eaf605856d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-cac1fc8b-bec1-4606-a3a3-f3eaf605856d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:06.732158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:06.733172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:06.734050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 280/576] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:06.734724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fc8b-bec1-4606-a3a3-f3eaf605856d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.759047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73262-d5bb-42f0-97f2-95932b7a0d14 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.784636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:06.803340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.804294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.804744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.805217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.806372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:06.806863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:06.808664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:06.837928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 297/577] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:06.837928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.865622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fc8b-bec1-4606-a3a3-f3eaf605856d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:06.915805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:06.917078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:06.917542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:06.917842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:06.934904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:06.937441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:06.968919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:06.970275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:06.971139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:06.971139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:06.971139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:06.971139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:06.971139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 281/578] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:06.972187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:06.983271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc942c-047f-48f7-b84e-d1656917514c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.002022 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:07.034162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.035292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.035817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.036794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.038043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:07.038556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.041135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.056657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 298/579] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:07.058121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:07.100994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:07.113252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6fca-5c93-4882-b331-441ca56a72b0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.157769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.158427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.158706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.158979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.159708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:07.160004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.161591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.175674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 282/580] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:07.175674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:07.182774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4bcf9-0a43-4d5d-981f-ebef78668a60 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.235349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.236537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.236991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.237439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.254224 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.257270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:07.287345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:07.289432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:07.291160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:07.291160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:07.291160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:07.291160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:07.291160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 299/581] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:07.291704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:07.332158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6467ff-cd36-464b-bb14-bc9d93962a8a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.335104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:07.385511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.386514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.386967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.387418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.388674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:07.389186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.391499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.411261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 283/582] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:07.412739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:07.429902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:07.449804 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c43bf-dded-4803-9c22-8253b288deb2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.490066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.490859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.491134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.491404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.503873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.505729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:07.525277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:07.526300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:07.528158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:07.528158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:07.528158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:07.528158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:07.528158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 300/583] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:07.528158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:07.541569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9c62c-9aa3-4010-9840-1ff37dc465ec None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.585314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.586552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.587174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.587610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.602235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.603762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:07.624474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:07.625910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:07.627873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:07.627873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:07.627873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:07.627873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:07.628470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 284/584] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:07.629035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:07.629298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:07.655491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5192-3dac-4142-830d-b400eede7058 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.707266 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.708906 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.709355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.709803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.711013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:07.711742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.713547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.726465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:07.737034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 301/585] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:07.737034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:07.783242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced18e9-f202-46dd-9f40-5e785e3b10df None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.836071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.837277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.837725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.838172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.848251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.851275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:07.873961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:07.874843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:07.875706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:07.875706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:07.875706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:07.875706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:07.875706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:07.875706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:07.875706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:07.875706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:07.876125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 285/586] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:07.877419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:07.887814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1cf8-d44f-4f4b-b6e9-11426ee4813d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:07.937061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:07.938149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:07.938557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:07.939006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:07.939902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:07.940356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:07.943247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:07.951375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:07.965050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 302/587] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:07.965050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.013343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add372df-3c18-454e-b1ca-34d6a866e425 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.044009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:08.055956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.056637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.056933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.057182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.057936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:08.058240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.059622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.078701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 286/588] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:08.078701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.102712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66027d2-62ae-4a66-aec4-a6c53974c73e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.147703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248363be-8a6e-440f-8528-089450440795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.148549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248363be-8a6e-440f-8528-089450440795 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.148829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248363be-8a6e-440f-8528-089450440795 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.149103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248363be-8a6e-440f-8528-089450440795 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.157155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248363be-8a6e-440f-8528-089450440795 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.158726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248363be-8a6e-440f-8528-089450440795 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-248363be-8a6e-440f-8528-089450440795 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:08.174543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:08.175645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 303/589] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:08.178341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248363be-8a6e-440f-8528-089450440795 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.215064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0f4f7-4201-4415-bf94-51e6cb6bdd93 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.245492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:08.257992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.258651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.258926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.259198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.262897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:08.262897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.262897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.275202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 287/590] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:08.281321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.303010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248363be-8a6e-440f-8528-089450440795 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.329209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:08.357851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.359345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.359947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.360613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.375634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.378249 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.386708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d596fa-c84b-4278-a51f-f1cb96dfd7c4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:08.406034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:08.407210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:52:08.408275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:08.408829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 304/591] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:08.409588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.427511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.428337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.428670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.428900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.438309 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.439781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:08.455822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:08.463970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 288/592] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:08.465748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.558438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8409-0314-4776-9130-2d0552ae672b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.577402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a69bf-b8b0-4878-8fc0-3220bc7b8a19 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.580861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:08.584666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:08.610464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.611015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.611292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.611664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.612742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:08.613027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.615053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.619645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949616da-e0c3-4cf2-ae0a-73b9765d9e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.620590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949616da-e0c3-4cf2-ae0a-73b9765d9e5b None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.624803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949616da-e0c3-4cf2-ae0a-73b9765d9e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.624803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949616da-e0c3-4cf2-ae0a-73b9765d9e5b None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/43a2c87f8db748ba9264b141f059aab9/roles/a9ef6ba6c6a94fc7bcb5d8b628725987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.630874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 305/593] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:08.633768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.639353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949616da-e0c3-4cf2-ae0a-73b9765d9e5b None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=43a2c87f8db748ba9264b141f059aab9, role_id=a9ef6ba6c6a94fc7bcb5d8b628725987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.640839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949616da-e0c3-4cf2-ae0a-73b9765d9e5b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.707186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 289/594] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:08 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/43a2c87f8db748ba9264b141f059aab9/roles/a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:08.708073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949616da-e0c3-4cf2-ae0a-73b9765d9e5b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.757449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52242d-2b4b-4232-95ca-c828f645d994 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.820344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.821402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.821869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.822327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.823789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:08.824339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.826854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.857779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 306/595] 10.222.0.123 () {56 vars in 1142 bytes} [Thu May 26 17:52:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:08.859121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:08.878879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949616da-e0c3-4cf2-ae0a-73b9765d9e5b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.905844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:08.935482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6aa40-b977-4d5f-a76b-1c05db2c35a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:08.936594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6aa40-b977-4d5f-a76b-1c05db2c35a5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.937064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6aa40-b977-4d5f-a76b-1c05db2c35a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.937531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6aa40-b977-4d5f-a76b-1c05db2c35a5 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.939053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6aa40-b977-4d5f-a76b-1c05db2c35a5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:08.939584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6aa40-b977-4d5f-a76b-1c05db2c35a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:08.942385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6aa40-b977-4d5f-a76b-1c05db2c35a5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:08.981260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 290/596] 10.222.0.123 () {56 vars in 1144 bytes} [Thu May 26 17:52:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:08.983524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67c87-db38-40d5-956c-cd1bdbc3c27a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:08.983911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92f2fb-171c-4e23-a0a4-191f34f9fe13 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:08.984051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67c87-db38-40d5-956c-cd1bdbc3c27a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:08.984513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67c87-db38-40d5-956c-cd1bdbc3c27a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:08.987071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 291/597] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:08.988129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67c87-db38-40d5-956c-cd1bdbc3c27a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:09.006237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:09.027675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a0e74-ba42-4451-9286-e7e95794ea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:09.028595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a0e74-ba42-4451-9286-e7e95794ea73 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:09.028865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a0e74-ba42-4451-9286-e7e95794ea73 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:09.029140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a0e74-ba42-4451-9286-e7e95794ea73 None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/6fd75bf129c642a89153efcb584406d8/roles/a9ef6ba6c6a94fc7bcb5d8b628725987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:09.048241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a0e74-ba42-4451-9286-e7e95794ea73 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=6fd75bf129c642a89153efcb584406d8, role_id=a9ef6ba6c6a94fc7bcb5d8b628725987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:09.050642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a0e74-ba42-4451-9286-e7e95794ea73 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:09.109027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67c87-db38-40d5-956c-cd1bdbc3c27a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:09.145076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d862921-c1a5-40ec-b212-0e4f52d967bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:09.146621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862921-c1a5-40ec-b212-0e4f52d967bf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:09.146916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862921-c1a5-40ec-b212-0e4f52d967bf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:09.147171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862921-c1a5-40ec-b212-0e4f52d967bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:09.149378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 307/598] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:08 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/6fd75bf129c642a89153efcb584406d8/roles/a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:09.150442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a0e74-ba42-4451-9286-e7e95794ea73 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:09.177332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d862921-c1a5-40ec-b212-0e4f52d967bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:09.181782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d862921-c1a5-40ec-b212-0e4f52d967bf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7d862921-c1a5-40ec-b212-0e4f52d967bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:09.221767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:09.223710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:09.225911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:09.225911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:09.225911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:09.225911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:09.236199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 292/599] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:09.239524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba68401-a035-40ee-bf6f-ba3c78015efa None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:09.240326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba68401-a035-40ee-bf6f-ba3c78015efa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:09.240957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba68401-a035-40ee-bf6f-ba3c78015efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:09.271619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fba68401-a035-40ee-bf6f-ba3c78015efa None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:09.273924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fba68401-a035-40ee-bf6f-ba3c78015efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:09.337693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:09.376615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a0e74-ba42-4451-9286-e7e95794ea73 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:09.381433 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:09.391945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 293/600] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:09.397142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba68401-a035-40ee-bf6f-ba3c78015efa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:09.429458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:09.430576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:09.431007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:09.431426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:09.443023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:09.444738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:09.463837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:09.464912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:09.465795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:09.465795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:09.465795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:09.465795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:09.467632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 308/601] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:09.468648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:09.565649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba68401-a035-40ee-bf6f-ba3c78015efa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:09.611905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:09.613426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:09.613852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:09.614315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:09.615775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:09.616244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:09.619605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:09.620965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c6a6-492a-4e25-82e2-d782f6fb062e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:09.642683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 294/602] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:09.642683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:09.679121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f7b21-e9c0-400e-b066-f743609c8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:09.680215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7b21-e9c0-400e-b066-f743609c8dbe None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:09.680724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7b21-e9c0-400e-b066-f743609c8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:09.681177 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f7b21-e9c0-400e-b066-f743609c8dbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:09.689425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:09.695163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f7b21-e9c0-400e-b066-f743609c8dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-498f7b21-e9c0-400e-b066-f743609c8dbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:09.703531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:09.704738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:09.705593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:09.708095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 309/603] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:09.710180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f7b21-e9c0-400e-b066-f743609c8dbe None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:09.732272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:09.805348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb988b0-9b82-4306-86d0-7680e08b2d85 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:09.844053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f7b21-e9c0-400e-b066-f743609c8dbe None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:09.876242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:09.877775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:09.878360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:09.878944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:09.881020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:09.881603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:09.883631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:09.883920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:09.884819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:09.885304 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:09.885723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:09.900990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 295/604] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:09.902166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:09.909573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:09.913312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:09.932854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:09.933900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:09.934816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:09.934816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:09.934816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:09.934816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:09.934816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:09.934816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:09.934816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:09.934816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:09.940404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 310/605] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:09.941477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:10.010056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:10.059781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c38255-d0d7-4c9b-a9aa-96cd83c765fb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:10.102680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:10.103758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:10.104190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:10.104667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:10.113616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:10.115518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:10.127812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92a8a-c01a-441b-ae64-4ccabe484e43 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:10.134662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:10.135538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:10.136439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:10.136439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:10.136439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:10.136439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:10.136439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:10.136439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:10.136439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:10.136439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:10.140680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 311/606] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:10.141717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:10.164744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:10.204256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:10.205185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:10.205617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:10.206035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:10.207871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:10.208399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:10.211505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:10.228478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 296/607] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:10.229943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:10.277433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69f804-fa20-4521-8d18-1d2ad6230342 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:10.312488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:10.347171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:10.348265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:10.348737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:10.349161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:10.350987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:10.351769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:10.354948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:10.356839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86bfcb-8bf2-48cd-bd0e-3baa8545a865 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:10.380909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 312/608] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:10.382661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:10.408317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:10.409368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:10.409786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:10.410207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:10.412936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:10.413561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:10.417186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:10.449449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 297/609] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:10.449449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:10.520501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af92bd-ca8a-4114-94de-7ba5e51dcfb5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:10.522676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:10.568063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:10.569191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:10.569613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:10.570026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:10.586116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:10.587835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:10.620907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:10.622560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:10.624228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:10.624228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:10.624228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:10.624228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:10.628414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 313/610] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:10.629997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:10.655554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72b4a4-4417-4b9f-bb20-d213c9b00f1e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:10.668761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:10.718138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2246305-7700-4184-9a9b-386b02a9fa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:10.719203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246305-7700-4184-9a9b-386b02a9fa77 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:10.719577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246305-7700-4184-9a9b-386b02a9fa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:10.719943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2246305-7700-4184-9a9b-386b02a9fa77 None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/425574d1c0a04fb29452e7f7d0b7d685/roles/a9ef6ba6c6a94fc7bcb5d8b628725987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:10.739066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2246305-7700-4184-9a9b-386b02a9fa77 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=425574d1c0a04fb29452e7f7d0b7d685, role_id=a9ef6ba6c6a94fc7bcb5d8b628725987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:10.741191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2246305-7700-4184-9a9b-386b02a9fa77 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:10.775377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565e797-4b17-442f-9067-2e512eb58051 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:10.816536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2fa0b-0412-4269-b330-c1394d2eae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:10.818514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2fa0b-0412-4269-b330-c1394d2eae92 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:10.818514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2fa0b-0412-4269-b330-c1394d2eae92 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:10.818813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2fa0b-0412-4269-b330-c1394d2eae92 None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/66452133fd6348109e3065303947ecce/roles/a9ef6ba6c6a94fc7bcb5d8b628725987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:10.837646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2fa0b-0412-4269-b330-c1394d2eae92 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=66452133fd6348109e3065303947ecce, role_id=a9ef6ba6c6a94fc7bcb5d8b628725987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:10.839161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2fa0b-0412-4269-b330-c1394d2eae92 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:10.856529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 298/611] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:10 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/425574d1c0a04fb29452e7f7d0b7d685/roles/a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:10.857626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2246305-7700-4184-9a9b-386b02a9fa77 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:10.954700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 314/612] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:10 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/66452133fd6348109e3065303947ecce/roles/a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:11.044141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:11.049193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207124f1-6660-46e1-8fe8-7ff5ad1320b3 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.049983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207124f1-6660-46e1-8fe8-7ff5ad1320b3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.056654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207124f1-6660-46e1-8fe8-7ff5ad1320b3 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.056654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 315/613] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:11 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:11.065974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc04ed-687b-4950-ac86-464043c49c23 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.066732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc04ed-687b-4950-ac86-464043c49c23 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.067726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc04ed-687b-4950-ac86-464043c49c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.071932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2246305-7700-4184-9a9b-386b02a9fa77 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:11.096528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a4fc04ed-687b-4950-ac86-464043c49c23 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:11.097997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a4fc04ed-687b-4950-ac86-464043c49c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:11.124124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:11.124867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.125150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.125432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.126200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:11.126705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:11.127934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:11.142827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 299/614] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:11.150835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:11.182848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 316/615] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:11.219566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc04ed-687b-4950-ac86-464043c49c23 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:11.256670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:11.295296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81217598-38aa-4e35-b95e-2eed55552a03 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:11.340569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:11.342324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.342620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.342898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.352927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:11.354970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:11.374597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:11.375739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:11.376731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:11.377251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc04ed-687b-4950-ac86-464043c49c23 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:11.377681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 300/616] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:11.383294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:11.403778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:11.448731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f554381-1860-4158-8f78-1bfe8372430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:11.449544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554381-1860-4158-8f78-1bfe8372430a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.449823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554381-1860-4158-8f78-1bfe8372430a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.450082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554381-1860-4158-8f78-1bfe8372430a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.479719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f554381-1860-4158-8f78-1bfe8372430a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-7f554381-1860-4158-8f78-1bfe8372430a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:11.494696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:11.496694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:11.498463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 317/617] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:11.507146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f554381-1860-4158-8f78-1bfe8372430a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:11.612765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:11.627830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fd239-9c8f-4113-9371-240b5460f446 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:11.639040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f554381-1860-4158-8f78-1bfe8372430a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:11.679543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:11.680692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.681601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.682073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.683015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:11.683518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:11.685150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:11.696254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 318/618] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:11.705179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:11.719519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:11.720506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.721076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.722630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.724232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:11.726283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:11.729476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:11.767024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 301/619] 10.222.0.123 () {56 vars in 1140 bytes} [Thu May 26 17:52:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:11.779530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:11.874987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:11.901031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aea022-db37-44ee-8872-8746609a28b7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:11.920267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae99472-85cb-43cf-a433-73166b1b1201 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:11.933446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:11.938576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:11.939419 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.939665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.939952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.951667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:11.963097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:11.963236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:11.963813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:11.964292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:11.964813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:11.980358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:11.981482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:11.982399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:11.982399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:11.982399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:11.982399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:11.982399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 319/620] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:11.985171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:11.991794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:11.993549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:12.027778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:12.028953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:12.030053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:12.030053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:12.030053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:12.030053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:12.032199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 302/621] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:12.040746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:12.178040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadad71-f4e7-4687-baae-34badb9091a8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.215613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a2948-5c99-4bd1-9176-3b439b870c02 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.228523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343fcc4-e4f0-4475-87ed-4118dd998968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:12.229678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343fcc4-e4f0-4475-87ed-4118dd998968 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.230137 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343fcc4-e4f0-4475-87ed-4118dd998968 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.230615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343fcc4-e4f0-4475-87ed-4118dd998968 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.231564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343fcc4-e4f0-4475-87ed-4118dd998968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:12.232194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343fcc4-e4f0-4475-87ed-4118dd998968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:12.233934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343fcc4-e4f0-4475-87ed-4118dd998968 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:12.235329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:12.249205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 320/622] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:12.250877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac872-a987-4498-bd6e-1e81be953b43 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.251330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac872-a987-4498-bd6e-1e81be953b43 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.252829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac872-a987-4498-bd6e-1e81be953b43 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.258236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 321/623] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:12.258962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f26d1-6603-45e0-ba77-440979a590fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:12.259090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac872-a987-4498-bd6e-1e81be953b43 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:12.260169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f26d1-6603-45e0-ba77-440979a590fc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.260731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f26d1-6603-45e0-ba77-440979a590fc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.261209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f26d1-6603-45e0-ba77-440979a590fc None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.262140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f26d1-6603-45e0-ba77-440979a590fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:12.262659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f26d1-6603-45e0-ba77-440979a590fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:12.264259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f26d1-6603-45e0-ba77-440979a590fc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:12.276960 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 303/624] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:12.278918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de442ef-7d22-4049-936d-f14d362afe1f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.279591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de442ef-7d22-4049-936d-f14d362afe1f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.280072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de442ef-7d22-4049-936d-f14d362afe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.311761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8de442ef-7d22-4049-936d-f14d362afe1f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:12.313346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8de442ef-7d22-4049-936d-f14d362afe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:12.313917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:12.374940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac872-a987-4498-bd6e-1e81be953b43 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.394648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 304/625] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:12.396424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de442ef-7d22-4049-936d-f14d362afe1f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:12.434399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:12.434399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.434979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.434979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.447532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:12.449060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:12.465818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:12.466810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 17:52:12.467767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:12.471767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 322/626] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:12.472686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:12.512764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de442ef-7d22-4049-936d-f14d362afe1f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.521728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:12.558449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:12.559735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.560115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.560516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.569714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:12.571322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:12.585329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2822-83c4-4a2f-97c8-41f5b81331f7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.587959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:12.591316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:12.592195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:12.593281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:12.593281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:12.593281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:12.593281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:12.593281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:12.593281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:12.593281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:12.593281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:12.595766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 305/627] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:12.596864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:12.623639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec7a0-6998-49f3-b1ba-2a23cf3972f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:12.624268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7a0-6998-49f3-b1ba-2a23cf3972f0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.624598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7a0-6998-49f3-b1ba-2a23cf3972f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.624875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7a0-6998-49f3-b1ba-2a23cf3972f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.637486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec7a0-6998-49f3-b1ba-2a23cf3972f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0a0ec7a0-6998-49f3-b1ba-2a23cf3972f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:12.646857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:12.647788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:12.648669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:12.653052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 323/628] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:12.654039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec7a0-6998-49f3-b1ba-2a23cf3972f0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:12.719729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467c90e-76d1-4e8e-9ac9-c1d0c7076e44 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.760251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:12.761090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.761377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.761656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.762546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:12.762820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:12.764287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:12.774206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec7a0-6998-49f3-b1ba-2a23cf3972f0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.797560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 306/629] 10.222.0.123 () {56 vars in 1142 bytes} [Thu May 26 17:52:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:12.798818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:12.820009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:12.821097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.821554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.822255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.823649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:12.824137 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:12.825770 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:12.830557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:12.844987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 324/630] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:12.848527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:12.886789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:12.930060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294fcce-afc2-4ef5-867c-675ed6db9a70 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.971203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1dd85-3de5-4ecd-a306-2f32086c9d70 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:12.976924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:12.977592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:12.977869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:12.978140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:12.978884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:12.979189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:12.980583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:12.996295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 307/631] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:12.996295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:13.017825 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a62ad4-e4c7-4d63-a344-3c883b59d9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:13.018916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62ad4-e4c7-4d63-a344-3c883b59d9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.019506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62ad4-e4c7-4d63-a344-3c883b59d9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.020031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62ad4-e4c7-4d63-a344-3c883b59d9b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.095381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:13.111612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce605778-0cc1-4913-8239-5fe8e81837cc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:13.112954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a62ad4-e4c7-4d63-a344-3c883b59d9b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:13.115973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a62ad4-e4c7-4d63-a344-3c883b59d9b5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:13.149154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80136762-8193-4694-a161-7a72d4aa8281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:13.149792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:13.151697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136762-8193-4694-a161-7a72d4aa8281 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.157511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136762-8193-4694-a161-7a72d4aa8281 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.157511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80136762-8193-4694-a161-7a72d4aa8281 None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/a2fbee9630954680bcec917996319e3a/roles/a9ef6ba6c6a94fc7bcb5d8b628725987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.170932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80136762-8193-4694-a161-7a72d4aa8281 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=a2fbee9630954680bcec917996319e3a, role_id=a9ef6ba6c6a94fc7bcb5d8b628725987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:13.172816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80136762-8193-4694-a161-7a72d4aa8281 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:13.240461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 325/632] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:13.240461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a62ad4-e4c7-4d63-a344-3c883b59d9b5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:13.349118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 308/633] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:12 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/a2fbee9630954680bcec917996319e3a/roles/a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:13.350358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80136762-8193-4694-a161-7a72d4aa8281 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:13.364231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a62ad4-e4c7-4d63-a344-3c883b59d9b5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:13.400622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:13.421324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0bab-c911-4bb2-942c-48f906687d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:13.422173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0bab-c911-4bb2-942c-48f906687d4b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.422474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0bab-c911-4bb2-942c-48f906687d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.422754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0bab-c911-4bb2-942c-48f906687d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.439026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a0bab-c911-4bb2-942c-48f906687d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:13.440586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a0bab-c911-4bb2-942c-48f906687d4b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-de8a0bab-c911-4bb2-942c-48f906687d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:13.468463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:13.469589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:13.470449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:13.470449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:13.470449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:13.470449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:13.473313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 326/634] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:13.473476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b022ea-382c-43ee-85ec-58438769b340 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.473756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b022ea-382c-43ee-85ec-58438769b340 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.474038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b022ea-382c-43ee-85ec-58438769b340 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.480262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 327/635] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:13 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:13.481661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b022ea-382c-43ee-85ec-58438769b340 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:13.512357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80136762-8193-4694-a161-7a72d4aa8281 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:13.554605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9bf21-4b58-4667-8041-9d3f4d027a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:13.555883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9bf21-4b58-4667-8041-9d3f4d027a66 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.556059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9bf21-4b58-4667-8041-9d3f4d027a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.556217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9bf21-4b58-4667-8041-9d3f4d027a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.560175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:13.570163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9bf21-4b58-4667-8041-9d3f4d027a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:13.576096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9bf21-4b58-4667-8041-9d3f4d027a66 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1ca9bf21-4b58-4667-8041-9d3f4d027a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:13.593527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:13.594466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:13.595307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:13.595307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:13.595307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:13.595307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:13.595307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 309/636] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:13.596365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363fb4c-b9b1-419d-8fcf-ef71c286efcb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.596903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363fb4c-b9b1-419d-8fcf-ef71c286efcb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.597185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363fb4c-b9b1-419d-8fcf-ef71c286efcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.620144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5363fb4c-b9b1-419d-8fcf-ef71c286efcb None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:13.621612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5363fb4c-b9b1-419d-8fcf-ef71c286efcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:13.626208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b022ea-382c-43ee-85ec-58438769b340 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:13.671169 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:13.672205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.673102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.673577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.674821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:13.675601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:13.678655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:13.696713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 328/637] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:13.698565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:13.708450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 310/638] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:13.709987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363fb4c-b9b1-419d-8fcf-ef71c286efcb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:13.754025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:13.851164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363fb4c-b9b1-419d-8fcf-ef71c286efcb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:13.863988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168cd2c-49bd-40a2-a132-c40762bf41a0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:13.873656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:13.896042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:13.896876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.897162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.897444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.906503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:13.907962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:13.927779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:13.930070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 311/639] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:52:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:13.931807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:13.935334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:13.936015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:13.936294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:13.936614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:13.937328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:13.937637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:13.939013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:13.958760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 329/640] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:13.959528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:14.077246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:14.084608 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634a75-a96d-4c28-9676-d728603fc8c0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:14.125171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:14.125753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.126040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.126331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.127252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:14.128051 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:14.129912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:14.152416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 330/641] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:52:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:14.158122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:14.159759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016ee0-cab0-4313-a944-12e0c527eb3e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:14.221952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375ff5-e678-4407-a60b-e0e41594ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:14.224111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375ff5-e678-4407-a60b-e0e41594ecaa None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.224889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375ff5-e678-4407-a60b-e0e41594ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.225673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375ff5-e678-4407-a60b-e0e41594ecaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.244242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c375ff5-e678-4407-a60b-e0e41594ecaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5c375ff5-e678-4407-a60b-e0e41594ecaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:14.260211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:14.262007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:14.263362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:14.267009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 312/642] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:14.268463 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375ff5-e678-4407-a60b-e0e41594ecaa None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:14.270924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef032b4-3248-45a2-a577-3353e4c8352a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:14.315952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:14.316785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.317075 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.317510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.325029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:14.326618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:14.341675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:14.343084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:14.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:14.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:14.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:14.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:14.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:14.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:14.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:14.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:14.347692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 331/643] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:14.349852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:14.350911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:14.367477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:14.428912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375ff5-e678-4407-a60b-e0e41594ecaa None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:14.464731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773dcd-7422-402f-8bb5-5ba7abc6677d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:14.465377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773dcd-7422-402f-8bb5-5ba7abc6677d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.465822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773dcd-7422-402f-8bb5-5ba7abc6677d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.466101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773dcd-7422-402f-8bb5-5ba7abc6677d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.495717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a780-41b8-4c95-9313-0f0d1adba493 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:14.540901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773dcd-7422-402f-8bb5-5ba7abc6677d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:14.542382 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773dcd-7422-402f-8bb5-5ba7abc6677d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:14.546556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:14.547544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.547965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.548409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.549568 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:14.550029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:14.552194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:14.565105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 332/644] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:14.566331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:14.588080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:14.665739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 313/645] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:14.667603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf508c5a-e78b-44a5-811d-e3f852cabbb6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.668090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf508c5a-e78b-44a5-811d-e3f852cabbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.668650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf508c5a-e78b-44a5-811d-e3f852cabbb6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.670284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 314/646] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:14.671543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf508c5a-e78b-44a5-811d-e3f852cabbb6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:14.689612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:14.726933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d96e8-2138-4540-9734-fc5958c3fb03 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:14.781974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:14.783012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.783600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.783955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.785044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:14.785557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:14.799502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:14.825747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 333/647] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:14.825747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:14.827307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf508c5a-e78b-44a5-811d-e3f852cabbb6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:14.881485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a3b82-afb4-4327-82e0-4f733f318ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:14.882706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a3b82-afb4-4327-82e0-4f733f318ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.883148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a3b82-afb4-4327-82e0-4f733f318ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.883589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a3b82-afb4-4327-82e0-4f733f318ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.894021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:14.900425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a3b82-afb4-4327-82e0-4f733f318ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:14.903029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a3b82-afb4-4327-82e0-4f733f318ae2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ff4a3b82-afb4-4327-82e0-4f733f318ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:14.936029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:14.937329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:14.943351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:14.943351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:14.943351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:14.943351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:14.943351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 315/648] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:14.943351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9e417-991d-4727-af88-e0a7f2bdc5cd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:14.943351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9e417-991d-4727-af88-e0a7f2bdc5cd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:14.943351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9e417-991d-4727-af88-e0a7f2bdc5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:14.957369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5fb9e417-991d-4727-af88-e0a7f2bdc5cd None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:14.958609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5fb9e417-991d-4727-af88-e0a7f2bdc5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:14.978181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fcf09-9ba6-4e72-a3db-321651eaae7f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.014604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.015409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.015689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.015959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.020947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:15.029698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:15.031448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:15.036732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 316/649] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:15.037899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9e417-991d-4727-af88-e0a7f2bdc5cd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:15.062410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:15.063531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:15.064658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:15.064658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:15.064658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:15.064658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:15.068367 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 334/650] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:15.068367 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.161582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9e417-991d-4727-af88-e0a7f2bdc5cd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.183272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:15.186470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e35acf-b326-40cb-909d-637b2c441129 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.203397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398b665-d092-4406-9937-03add2792a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.203969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b665-d092-4406-9937-03add2792a6d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.204250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b665-d092-4406-9937-03add2792a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.204549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b665-d092-4406-9937-03add2792a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.205379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398b665-d092-4406-9937-03add2792a6d None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=43a2c87f8db748ba9264b141f059aab9) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:15.205685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398b665-d092-4406-9937-03add2792a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:15.207147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398b665-d092-4406-9937-03add2792a6d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:15.213524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 317/651] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/role_assignments?user.id=43a2c87f8db748ba9264b141f059aab9&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 610 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:15.214165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398b665-d092-4406-9937-03add2792a6d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.234778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.235849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.236363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.236716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.237560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:15.237941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:15.240950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:15.256048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 335/652] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:15.258564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.331436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:15.367574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398b665-d092-4406-9937-03add2792a6d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.401187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c721f6e-5709-4d0a-848f-02d74c50bc01 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.412666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898363db-c7c8-48f1-a905-b295ebb915d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.413862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898363db-c7c8-48f1-a905-b295ebb915d3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.413862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898363db-c7c8-48f1-a905-b295ebb915d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.414035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898363db-c7c8-48f1-a905-b295ebb915d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.428052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898363db-c7c8-48f1-a905-b295ebb915d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-898363db-c7c8-48f1-a905-b295ebb915d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:15.436499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:15.437432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:15.438326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:15.442518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 318/653] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:15.443494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898363db-c7c8-48f1-a905-b295ebb915d3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.451682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.451682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.451976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.452186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.453348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:15.453348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:15.454588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:15.470749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 336/654] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:15.471618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.513907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:15.588322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898363db-c7c8-48f1-a905-b295ebb915d3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.603675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98abec-e231-43a8-a7ab-becc2966bcce None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.617118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:15.630369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.631928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.632449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.632903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.642402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:15.644102 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:15.649812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.650554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.651053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.651400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.652532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:15.652909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:15.654335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:15.661613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:15.662578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:52:15.663632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:15.666112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 319/656] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:15.667122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.669365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 337/656] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:15.670720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.788422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec020-bf0a-4af8-87db-e0969caa4299 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.791615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:15.802381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9b0b2-5242-40af-9b7b-e018bf2dda8c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:15.830910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.835224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.835503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.835786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.840852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e87545-e019-4bec-900b-06f0775f7687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:15.841991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e87545-e019-4bec-900b-06f0775f7687 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.841991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e87545-e019-4bec-900b-06f0775f7687 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.842476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e87545-e019-4bec-900b-06f0775f7687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.843169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:15.844657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:15.853907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e87545-e019-4bec-900b-06f0775f7687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:15.855363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e87545-e019-4bec-900b-06f0775f7687 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:15.859534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:15.860660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:15.861533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:15.861533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:15.861533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:15.861533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:15.861533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:15.861533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:15.861533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:15.861533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:15.866123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 320/657] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:15.866896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b4e87545-e019-4bec-900b-06f0775f7687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:15.874486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:15.875338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:15.876195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:15.876195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:15.876195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:15.876195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:15.876195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 338/658] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:15.877562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35a32-0b97-4244-acb9-a3e32bcb97ff None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:15.877562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35a32-0b97-4244-acb9-a3e32bcb97ff None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:15.877829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35a32-0b97-4244-acb9-a3e32bcb97ff None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:15.879178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 339/659] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:15.881716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f35a32-0b97-4244-acb9-a3e32bcb97ff None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:15.916447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:15.979009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c7e90-e237-4dc0-a0b7-36e8fcaa1838 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.001074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f35a32-0b97-4244-acb9-a3e32bcb97ff None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.019592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:16.020274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.020762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.021080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.021921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:16.022236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:16.023695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:16.041188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302d458-e8ef-4113-9656-c3d9e12545f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:16.041786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 321/660] 10.222.0.123 () {56 vars in 1142 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:16.042263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302d458-e8ef-4113-9656-c3d9e12545f8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.042645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:16.042817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302d458-e8ef-4113-9656-c3d9e12545f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.043241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302d458-e8ef-4113-9656-c3d9e12545f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.044033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302d458-e8ef-4113-9656-c3d9e12545f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:16.044363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302d458-e8ef-4113-9656-c3d9e12545f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:16.045809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302d458-e8ef-4113-9656-c3d9e12545f8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:16.059738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 340/661] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:16.069835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13023b0-ecce-4dcf-9faa-37f7a92a5930 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.069835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13023b0-ecce-4dcf-9faa-37f7a92a5930 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.069835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13023b0-ecce-4dcf-9faa-37f7a92a5930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.077945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:16.082270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d13023b0-ecce-4dcf-9faa-37f7a92a5930 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:16.084290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d13023b0-ecce-4dcf-9faa-37f7a92a5930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:16.164769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d87c6-440e-47e1-8a89-4dff8f213ea0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.165488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 341/662] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:16.166792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13023b0-ecce-4dcf-9faa-37f7a92a5930 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:16.193413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:16.204046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:16.205173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.205173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.205453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.207940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:16.207940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:16.207940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:16.221067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 322/663] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:16.221869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:16.306921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13023b0-ecce-4dcf-9faa-37f7a92a5930 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.316722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:16.335298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3699d6-94ba-4302-bc1e-60cb3f6ca50a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.351551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29303-5101-45ce-bd6e-d473b6fa516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:16.352226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29303-5101-45ce-bd6e-d473b6fa516d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.352564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29303-5101-45ce-bd6e-d473b6fa516d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.352848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29303-5101-45ce-bd6e-d473b6fa516d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.370245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:16.371052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.371159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.371437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.372349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=6fd75bf129c642a89153efcb584406d8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:16.372667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:16.374115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:16.392339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 323/664] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:16 2022] GET /identity/v3/role_assignments?user.id=6fd75bf129c642a89153efcb584406d8&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 610 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:16.392339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:16.467747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29303-5101-45ce-bd6e-d473b6fa516d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:16.470108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29303-5101-45ce-bd6e-d473b6fa516d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:16.487298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:16.515800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f4162-56b2-4a08-bf89-d6a4fb839953 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.559162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac674d-0761-4a5c-9a1e-d67f07f2b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:16.560116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac674d-0761-4a5c-9a1e-d67f07f2b807 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.560546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac674d-0761-4a5c-9a1e-d67f07f2b807 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.560918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac674d-0761-4a5c-9a1e-d67f07f2b807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.575686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac674d-0761-4a5c-9a1e-d67f07f2b807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-97ac674d-0761-4a5c-9a1e-d67f07f2b807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:16.585442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:16.586447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:16.587423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 324/665] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:16.592337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac674d-0761-4a5c-9a1e-d67f07f2b807 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:16.606481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:16.616570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 342/666] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:16.617630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29303-5101-45ce-bd6e-d473b6fa516d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:16.741907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac674d-0761-4a5c-9a1e-d67f07f2b807 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.756855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29303-5101-45ce-bd6e-d473b6fa516d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.784957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:16.789981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:16.791036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.791482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.791915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.800800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:16.803136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:16.807506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:16.808275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:16.808653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:16.808998 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:16.809878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:16.810216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:16.811995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:16.821590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:16.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 17:52:16.823565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:16.824133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 343/667] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:16 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:16.824133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:16.830856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 325/668] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:16.830856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:16.924577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:16.965310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d39e63-c7ef-4b94-b41d-158ad80fd456 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:16.979227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76a0b2-3897-4446-91d9-c5a68c502981 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:17.006931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.007844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.008132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.008448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.021168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.021809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.022662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.023049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.023571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.024044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.036742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.038662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:17.043030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:17.043937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:17.044845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:17.044845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:17.044845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:17.044845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:17.048696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 344/669] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:17.049774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:17.066224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:17.067123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:17.068076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:17.068076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:17.068076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:17.068076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:17.070414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 326/670] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:17.071589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.084338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:17.176267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00eec5-3d21-44ca-a2eb-63a73aef22bc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:17.207649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592424f6-735f-4517-861b-24430f7534e7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:17.224776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.225477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.225762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.226291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.227435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:17.228145 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:17.228485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.229958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.246812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.247682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.248072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.248495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.249320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:17.249728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.251301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.252760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 345/671] 10.222.0.123 () {56 vars in 1144 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:17.253772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.274699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 327/672] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:17.275945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.362740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:17.381151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21389558-de26-4a80-bf98-7886720fc48b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:17.417860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.418529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.418819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.419098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.419831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:17.420142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.421830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.427741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587919dd-ce59-45f8-b925-4847ea90e037 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:17.440597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 346/673] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:17.440597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.471821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8ee97-93fc-48ad-9453-03c7129b3d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.473324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8ee97-93fc-48ad-9453-03c7129b3d32 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.473847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8ee97-93fc-48ad-9453-03c7129b3d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.474270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8ee97-93fc-48ad-9453-03c7129b3d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.538562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:17.551050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9391-7727-4bbe-842e-b5c7212f596f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:17.571341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8ee97-93fc-48ad-9453-03c7129b3d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.573052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8ee97-93fc-48ad-9453-03c7129b3d32 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.598986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.600059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.600730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.601570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.611307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.613888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:17.636945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:17.638477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:17.639583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:17.639583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:17.639583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:17.639583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:17.639583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:17.639583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:17.639583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:17.639583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:17.647472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 347/674] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:17.647472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.649601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:17.703391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 328/675] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:17.704895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8ee97-93fc-48ad-9453-03c7129b3d32 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.781020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdecf7-6758-471c-b32e-cdc3abad7190 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:17.795718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:17.822134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.822938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.823216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.823482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.823791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8ee97-93fc-48ad-9453-03c7129b3d32 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:17.831249 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.832727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:17.847747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:17.849349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 348/676] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:17.850423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.870553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065397c-4fde-4e09-a9cf-84b93cfab2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:17.871557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065397c-4fde-4e09-a9cf-84b93cfab2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.872072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065397c-4fde-4e09-a9cf-84b93cfab2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.872468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065397c-4fde-4e09-a9cf-84b93cfab2c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.873265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065397c-4fde-4e09-a9cf-84b93cfab2c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:17.873577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065397c-4fde-4e09-a9cf-84b93cfab2c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:17.875020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065397c-4fde-4e09-a9cf-84b93cfab2c9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:17.888010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 329/677] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:17.889499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca015-eef6-4a97-a93d-e07b394f5384 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:17.889791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca015-eef6-4a97-a93d-e07b394f5384 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:17.890073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca015-eef6-4a97-a93d-e07b394f5384 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:17.891630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 330/678] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:17.892053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ca015-eef6-4a97-a93d-e07b394f5384 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:17.925068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:17.969244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549d8c-c388-487a-8817-02c64cce806c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:18.007304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ca015-eef6-4a97-a93d-e07b394f5384 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:18.008983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8fffc-120e-45e1-9881-b12c7f5ddfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:18.010642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8fffc-120e-45e1-9881-b12c7f5ddfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.010943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8fffc-120e-45e1-9881-b12c7f5ddfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.011208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8fffc-120e-45e1-9881-b12c7f5ddfd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.023841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8fffc-120e-45e1-9881-b12c7f5ddfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:18.025381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8fffc-120e-45e1-9881-b12c7f5ddfd7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:18.055105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:18.055983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.056263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.056567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.057429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:18.057735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:18.059231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:18.070125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:18.086530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 331/679] 10.222.0.123 () {56 vars in 1140 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:18.086530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-11c8fffc-120e-45e1-9881-b12c7f5ddfd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:18.173278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:18.174206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:18.175094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:18.175094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:18.175094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:18.175094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:18.180424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 349/680] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:18.182008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeee49-4f00-4dc3-9d61-a342877e3c16 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.182376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeee49-4f00-4dc3-9d61-a342877e3c16 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.182713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeee49-4f00-4dc3-9d61-a342877e3c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.200582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cdaeee49-4f00-4dc3-9d61-a342877e3c16 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:18.201844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cdaeee49-4f00-4dc3-9d61-a342877e3c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:18.208962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041798bd-4f80-4ac8-b9b2-94d435644e55 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:18.285817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 350/681] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:18.287317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeee49-4f00-4dc3-9d61-a342877e3c16 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:18.341643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:18.371987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:18.373060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.373343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.373616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.374453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=425574d1c0a04fb29452e7f7d0b7d685) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:18.374761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:18.376206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:18.392344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 332/682] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:18 2022] GET /identity/v3/role_assignments?user.id=425574d1c0a04fb29452e7f7d0b7d685&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 610 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:18.392344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:18.421347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeee49-4f00-4dc3-9d61-a342877e3c16 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:18.453137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:18.482815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f4cfd-c322-4575-b0f2-f4329417e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:18.483481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f4cfd-c322-4575-b0f2-f4329417e073 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.483935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f4cfd-c322-4575-b0f2-f4329417e073 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.484213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f4cfd-c322-4575-b0f2-f4329417e073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.508876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a800-9f99-40af-b9a4-cbd9fae07a1b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:18.546690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:18.547365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.547650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.547923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.548694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:18.548996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:18.550394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:18.564220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 333/683] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:18.569561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:18.585091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f4cfd-c322-4575-b0f2-f4329417e073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:18.589420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f4cfd-c322-4575-b0f2-f4329417e073 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:18.659293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:18.715452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344daa56-1f33-431e-bbda-b6bf1a96ac1a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:18.741846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:18.755208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 351/684] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:18.756920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f4cfd-c322-4575-b0f2-f4329417e073 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:18.761691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:18.767330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.767330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.767330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.774175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:18.775717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:18.796086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:18.797488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:18.798665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:18.798665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:18.798665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:18.798665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:18.798665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 334/685] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:18.798665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:18.903223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f4cfd-c322-4575-b0f2-f4329417e073 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:18.907107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e21ba7-97e8-4f8e-8fec-6e168cd81160 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:18.945091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:18.945900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.946159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f5b96-f7e6-4d1c-9b43-20b024078890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:18.946291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.946479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.947167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5b96-f7e6-4d1c-9b43-20b024078890 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.947505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5b96-f7e6-4d1c-9b43-20b024078890 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.947823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5b96-f7e6-4d1c-9b43-20b024078890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.954127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:18.956020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:18.959231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f5b96-f7e6-4d1c-9b43-20b024078890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:18.961187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f5b96-f7e6-4d1c-9b43-20b024078890 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:18.972424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:18.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:18.975119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 352/686] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:18.975772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5b2f5b96-f7e6-4d1c-9b43-20b024078890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:18.983152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:18.984056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:18.985297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:18.985297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:18.985297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:18.985297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:18.985297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 335/687] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:18.985846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a65b-3dfd-483f-b566-f9fff346727d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:18.986126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a65b-3dfd-483f-b566-f9fff346727d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:18.986396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a65b-3dfd-483f-b566-f9fff346727d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:18.992355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 336/688] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:18.992355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a65b-3dfd-483f-b566-f9fff346727d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:18.993088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:19.016464 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:19.097010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38ee86-932b-4ea4-8c3e-baf7b8b7b072 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:19.101423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a65b-3dfd-483f-b566-f9fff346727d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:19.133689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:19.134399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.134711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.134948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.135665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:19.135974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:19.137380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:19.138211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c23cf8-7918-42b0-871d-68f06ac53a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:19.138862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23cf8-7918-42b0-871d-68f06ac53a86 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.139156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23cf8-7918-42b0-871d-68f06ac53a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.139417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23cf8-7918-42b0-871d-68f06ac53a86 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.140199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c23cf8-7918-42b0-871d-68f06ac53a86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:19.140535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c23cf8-7918-42b0-871d-68f06ac53a86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:19.141953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c23cf8-7918-42b0-871d-68f06ac53a86 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:19.156088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 353/689] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:19.156088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:19.159151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 337/690] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:19.163760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841df0c-ac74-415e-8d51-736312a42829 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.163760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841df0c-ac74-415e-8d51-736312a42829 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.163760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841df0c-ac74-415e-8d51-736312a42829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.179306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8841df0c-ac74-415e-8d51-736312a42829 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:19.180534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8841df0c-ac74-415e-8d51-736312a42829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:19.227136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:19.257058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 338/691] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:19.258157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841df0c-ac74-415e-8d51-736312a42829 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:19.271915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec202829-f911-4e46-b25e-9f42e37938f7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:19.274329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:19.316969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:19.318154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.319006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.319283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.320008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:19.320336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:19.321829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:19.335357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 354/692] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:19.336466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:19.366406 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841df0c-ac74-415e-8d51-736312a42829 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:19.406079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e87c-705e-41e3-a106-5c2251a55def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:19.406964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e87c-705e-41e3-a106-5c2251a55def None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.407414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e87c-705e-41e3-a106-5c2251a55def None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.407835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e87c-705e-41e3-a106-5c2251a55def None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.408958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4e87c-705e-41e3-a106-5c2251a55def None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:19.412641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4e87c-705e-41e3-a106-5c2251a55def None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:19.443926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144fa6e-55f1-42f8-99e2-9fa7492ea1b7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:19.468784 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:19.477875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:19.478467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.478741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.479098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.479937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=66452133fd6348109e3065303947ecce) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:19.480243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:19.481682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:19.487427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 355/693] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:19 2022] GET /identity/v3/role_assignments?user.id=66452133fd6348109e3065303947ecce&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 610 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:19.488185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:19.510065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 339/694] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:52:19 2022] POST /identity/v3/users => generated 255 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:19.510669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e87c-705e-41e3-a106-5c2251a55def None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:19.644569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f3ce-c6ce-4aa0-9746-b70f5beda25c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:19.687620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:19.694743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7e43c-062f-4f94-8dd2-99e6f5b8eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:19.696225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7e43c-062f-4f94-8dd2-99e6f5b8eeaf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.696762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7e43c-062f-4f94-8dd2-99e6f5b8eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.697236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7e43c-062f-4f94-8dd2-99e6f5b8eeaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.711615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7e43c-062f-4f94-8dd2-99e6f5b8eeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a1d7e43c-062f-4f94-8dd2-99e6f5b8eeaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:19.722106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:19.723114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:19.724093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:19.726134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 356/695] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:19.733125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7e43c-062f-4f94-8dd2-99e6f5b8eeaf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:19.749055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e87c-705e-41e3-a106-5c2251a55def None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:19.798496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:19.799734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.800685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:19.801108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.801603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.812058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:19.813893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:19.832218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:19.833275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:19.834581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 340/696] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:19.839563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:19.866457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7e43c-062f-4f94-8dd2-99e6f5b8eeaf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:19.908267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:19.908971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:19.909256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:19.909535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:19.910400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:19.910768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:19.912609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:19.926175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 357/697] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:19.927991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:19.985187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5157929-42e3-46b5-83ae-b923484af96b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:20.030319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:20.043465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:20.044274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:20.046755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:20.046755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:20.046755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:20.047023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:20.048967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:20.060338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69829a0b-9556-4c60-82cb-9117deb27064 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:20.066467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 341/698] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:20.072340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:20.077839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:20.105661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:20.106957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:20.107538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:20.108035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:20.122155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:20.123929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:20.146778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:20.147718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:20.149104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:20.149104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:20.149104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:20.149104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:20.149104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 358/699] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:20.154261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:20.257695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5d0d7-ecff-4ce7-965e-5a8a6afe5842 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:20.305856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:20.306522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:20.306804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:20.307076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:20.307912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=a2fbee9630954680bcec917996319e3a) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:20.308221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:20.309694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:20.327021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 342/700] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:20 2022] GET /identity/v3/role_assignments?user.id=a2fbee9630954680bcec917996319e3a&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 610 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:20.363028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d5c9a-61f9-4041-af81-6198ae93ba1c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:20.407723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:20.408428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:20.408711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:20.408983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:20.409721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:20.410024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:20.411517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:20.426478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 359/701] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:20.433007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:20.515525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:20.576101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af087647-804a-473d-a477-f6f7178c96a7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:20.624857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:20.625654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:20.625932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:20.626201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:20.645651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:20.647225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:20.665515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:20.667979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:20.670313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 343/702] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:52:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:20.673279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:20.723158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:20.839988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff3828-777e-47e7-881f-cecddef9055b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:20.888537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79654f4b-af3c-4807-8e1a-86ac429f0124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:20.889210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79654f4b-af3c-4807-8e1a-86ac429f0124 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:20.889486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79654f4b-af3c-4807-8e1a-86ac429f0124 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:20.889758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79654f4b-af3c-4807-8e1a-86ac429f0124 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:20.890584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79654f4b-af3c-4807-8e1a-86ac429f0124 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:20.890886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79654f4b-af3c-4807-8e1a-86ac429f0124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:20.892297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79654f4b-af3c-4807-8e1a-86ac429f0124 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:20.916649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 360/703] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:52:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:20.922177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:21.025451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075b17-1d06-40f3-b068-89e5f04acfb5 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.025975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075b17-1d06-40f3-b068-89e5f04acfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.026249 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97075b17-1d06-40f3-b068-89e5f04acfb5 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.027750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 361/704] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:21.034141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a4d8b-7bfc-475d-b30f-9b03fc42fdc6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.034740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a4d8b-7bfc-475d-b30f-9b03fc42fdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.035214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a4d8b-7bfc-475d-b30f-9b03fc42fdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.045022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d90cf-2b5f-47b6-8e65-ea6db1778fd8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:21.059765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-987a4d8b-7bfc-475d-b30f-9b03fc42fdc6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:21.060710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:21.061640 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-987a4d8b-7bfc-475d-b30f-9b03fc42fdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:21.091454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38400-0ec4-41fc-8c2d-5fda97d66fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:21.092039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38400-0ec4-41fc-8c2d-5fda97d66fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.092391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38400-0ec4-41fc-8c2d-5fda97d66fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.092741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38400-0ec4-41fc-8c2d-5fda97d66fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.146174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 362/705] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 17:52:21.181636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a4d8b-7bfc-475d-b30f-9b03fc42fdc6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:21.199803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38400-0ec4-41fc-8c2d-5fda97d66fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:21.201447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38400-0ec4-41fc-8c2d-5fda97d66fb4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:21.209056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:21.382606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a4d8b-7bfc-475d-b30f-9b03fc42fdc6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:21.411761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 344/706] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:21.421447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38400-0ec4-41fc-8c2d-5fda97d66fb4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:21.440664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:21.443843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.445050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.445817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.446164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:21.446924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:21.449323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:21.470181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:21.471178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:21.472013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:21.475677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 363/707] 10.222.0.123 () {56 vars in 1134 bytes} [Thu May 26 17:52:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:21.490261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:21.550929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38400-0ec4-41fc-8c2d-5fda97d66fb4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:21.588435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:21.589228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.589805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.589967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.600513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:21.602101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:21.620684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:21.621622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:21.622513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:21.622513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:21.622513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:21.622513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:21.623306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 345/708] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:21.629237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:21.690567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:21.700694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:21.738036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd25bc-a511-4a0a-bee9-bb27dd7276d2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:21.777791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:21.778458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.778739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.779019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.779747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:21.780056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:21.781467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:21.786283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510fcc-91ba-479b-8394-20ceb273adfd None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:21.794149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 346/709] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:21.803314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:21.830427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:21.831086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.831365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.831635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.832363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:21.832795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:21.834421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:21.850658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 364/710] 10.222.0.123 () {56 vars in 1129 bytes} [Thu May 26 17:52:21 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:21.867991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:21.937877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a725-2e1c-408d-81d6-ee49b799efa2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:21.969053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:21.974436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:21.975230 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:21.975512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:21.975803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:21.983194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:21.984691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:22.007405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:22.008526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:22.009561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 347/711] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:22.017245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:22.134471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fef696-7e37-4ecf-9471-2819a70f6eeb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:22.150421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1640820-2d3d-4171-b763-851cf45b9da0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:22.200108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:22.202269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.202547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.202817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.203625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:22.203937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:22.205670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:22.222291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 348/712] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:22.228612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:22.237563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648de78-6dda-47ef-9dd3-6ce068ab16a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:22.238587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648de78-6dda-47ef-9dd3-6ce068ab16a8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.239083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648de78-6dda-47ef-9dd3-6ce068ab16a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.239700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648de78-6dda-47ef-9dd3-6ce068ab16a8 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.240830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648de78-6dda-47ef-9dd3-6ce068ab16a8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:22.241338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648de78-6dda-47ef-9dd3-6ce068ab16a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:22.242902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648de78-6dda-47ef-9dd3-6ce068ab16a8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:22.249720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 365/713] 10.222.0.123 () {56 vars in 1129 bytes} [Thu May 26 17:52:21 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:22.320277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:22.376133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec6bd1-b071-4f1f-8a40-ecde336bcf64 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:22.416971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61417baf-7e9e-4d54-9a47-e3e4321b2d91 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.417164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8e03f-834f-4449-b63d-279efd51c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:22.417756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61417baf-7e9e-4d54-9a47-e3e4321b2d91 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.417901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8e03f-834f-4449-b63d-279efd51c43a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.418071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8e03f-834f-4449-b63d-279efd51c43a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.418413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8e03f-834f-4449-b63d-279efd51c43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.418754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61417baf-7e9e-4d54-9a47-e3e4321b2d91 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.419259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8e03f-834f-4449-b63d-279efd51c43a None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=6fd75bf129c642a89153efcb584406d8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:22.419746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8e03f-834f-4449-b63d-279efd51c43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:22.421233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8e03f-834f-4449-b63d-279efd51c43a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:22.421483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 366/714] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:22.422990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccc22-93cd-4972-9d29-4a1d99747247 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.423491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccc22-93cd-4972-9d29-4a1d99747247 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.423975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccc22-93cd-4972-9d29-4a1d99747247 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.425686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 367/715] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:22.427083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00d84-a056-4e07-b532-ebf6a29c79ea None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.428212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00d84-a056-4e07-b532-ebf6a29c79ea None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.428688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 349/716] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:22 2022] GET /identity/v3/role_assignments?user.id=6fd75bf129c642a89153efcb584406d8&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:22.428973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00d84-a056-4e07-b532-ebf6a29c79ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.436958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60484c-0b4a-46be-a854-0634a02b23cb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.438319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60484c-0b4a-46be-a854-0634a02b23cb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.440018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60484c-0b4a-46be-a854-0634a02b23cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.446095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:22.470476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7be00d84-a056-4e07-b532-ebf6a29c79ea None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:22.472595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7be00d84-a056-4e07-b532-ebf6a29c79ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:22.481983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6f60484c-0b4a-46be-a854-0634a02b23cb None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:22.483623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6f60484c-0b4a-46be-a854-0634a02b23cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:22.584226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 350/717] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:22.584981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 368/718] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:22.607923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00d84-a056-4e07-b532-ebf6a29c79ea None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:22.610364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60484c-0b4a-46be-a854-0634a02b23cb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:22.659524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:22.719899 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00d84-a056-4e07-b532-ebf6a29c79ea None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:22.725064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60484c-0b4a-46be-a854-0634a02b23cb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:22.756598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:22.757405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.757681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.757949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] PATH_INFO: `/v3/services/network` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.758600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:22.760162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:22.762355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:22.776327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:22.780715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:22.781547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 369/719] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:22 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:22.782325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:22.797959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102794b-2daa-4803-8772-d9c54d5a3da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:22.798752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102794b-2daa-4803-8772-d9c54d5a3da7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.799033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102794b-2daa-4803-8772-d9c54d5a3da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.799302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102794b-2daa-4803-8772-d9c54d5a3da7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.817409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102794b-2daa-4803-8772-d9c54d5a3da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-8102794b-2daa-4803-8772-d9c54d5a3da7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:22.834577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:22.835588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:22.836452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 351/720] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:22.843482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102794b-2daa-4803-8772-d9c54d5a3da7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:22.888113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a633a-703d-478c-8a3b-f9591ca8fa0d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:22.922604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:22.923266 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:22.923543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:22.923813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:22.924551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:22.924854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:22.926212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:22.931934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 370/721] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:22 2022] GET /identity/v3/services?name=network => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:22.937276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:22.995476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102794b-2daa-4803-8772-d9c54d5a3da7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:23.003478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:23.033999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:23.034988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:23.035272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:23.035543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:23.036294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:23.036744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:23.038205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:23.048213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 352/722] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:23.057342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:23.182134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:23.189851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9842d2a-b440-42f8-bb63-857e4fe7eece None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:23.238497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:23.239340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:23.239674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:23.239951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:23.254317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed319110-228e-4f31-926f-9089ba0748b0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:23.260999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:23.267450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:23.308024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:23.308973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:23.309920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:23.309920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:23.309920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:23.309920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:23.311966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 353/723] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:23.323128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:23.345040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e5d88-f7e8-474b-9d48-7a7ffc87b5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:23.345761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e5d88-f7e8-474b-9d48-7a7ffc87b5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:23.346051 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e5d88-f7e8-474b-9d48-7a7ffc87b5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:23.346331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e5d88-f7e8-474b-9d48-7a7ffc87b5e6 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:23.347042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e5d88-f7e8-474b-9d48-7a7ffc87b5e6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:23.347350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e5d88-f7e8-474b-9d48-7a7ffc87b5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:23.348760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e5d88-f7e8-474b-9d48-7a7ffc87b5e6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:23.359246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:23.361737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 371/724] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:22 2022] GET /identity/v3/services?type=network => generated 125 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:23.457517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ec80-eac8-4d6d-b021-5e59e0f5d9b3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:23.460131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5510-9a1b-4db4-bdca-b25df8664041 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:23.460450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5510-9a1b-4db4-bdca-b25df8664041 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:23.460736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5510-9a1b-4db4-bdca-b25df8664041 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:23.463700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 372/725] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:23.468136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c256ca-8830-4daa-900d-3b2ab14b76c4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:23.468471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c256ca-8830-4daa-900d-3b2ab14b76c4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:23.468744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c256ca-8830-4daa-900d-3b2ab14b76c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:23.502338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d1c256ca-8830-4daa-900d-3b2ab14b76c4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:23.504219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:23.504990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:23.505812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:23.506099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:23.507100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:23.507408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:23.508563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d1c256ca-8830-4daa-900d-3b2ab14b76c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:23.510003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:23.534832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 354/726] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:23.540970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:23.653523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 373/727] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:23.677556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c256ca-8830-4daa-900d-3b2ab14b76c4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:23.681545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:23.714217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d3ba-2222-4765-95f5-9bbd8b70ef07 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:23.771736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:23.776915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:23.777723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:23.778006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:23.778283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:23.794847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:23.796324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:23.828296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:23.829335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:23.830260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 355/728] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:52:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:23.838391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:23.859879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c256ca-8830-4daa-900d-3b2ab14b76c4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:23.933031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa81283-f92d-4a32-9296-d19d59ceef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:23.933832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa81283-f92d-4a32-9296-d19d59ceef70 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:23.934109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa81283-f92d-4a32-9296-d19d59ceef70 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:23.934377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa81283-f92d-4a32-9296-d19d59ceef70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:23.965418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa81283-f92d-4a32-9296-d19d59ceef70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5fa81283-f92d-4a32-9296-d19d59ceef70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:23.981337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:23.982342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:23.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 374/729] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:23.993472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa81283-f92d-4a32-9296-d19d59ceef70 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:23.998008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab600-bacb-4e13-8ce9-ab6a331904a8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:24.038438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:24.039030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.039355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.039640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.040559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:24.040877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:24.043039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:24.044829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:24.064107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 356/730] 10.222.0.123 () {56 vars in 1154 bytes} [Thu May 26 17:52:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:24.073637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:24.183003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa81283-f92d-4a32-9296-d19d59ceef70 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:24.201420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:24.204396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121db9c8-d510-4228-b11b-b2bcc102c245 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:24.245018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee786ea-7b3d-4b43-ab02-4611383eeba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:24.246101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:24.246348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee786ea-7b3d-4b43-ab02-4611383eeba5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.246773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.247053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.247261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee786ea-7b3d-4b43-ab02-4611383eeba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.247372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.247834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee786ea-7b3d-4b43-ab02-4611383eeba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.248127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:24.248460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:24.249881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:24.271860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 375/731] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:24.286178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:24.322325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:24.333973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee786ea-7b3d-4b43-ab02-4611383eeba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:24.335821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee786ea-7b3d-4b43-ab02-4611383eeba5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:24.450257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 357/732] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 17:52:24.455253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee786ea-7b3d-4b43-ab02-4611383eeba5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:24.561044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:24.571575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee786ea-7b3d-4b43-ab02-4611383eeba5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:24.601627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f36ac-85e1-4126-89dc-0884d33f5c91 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:24.612784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:24.613861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.615351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.615836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.627303 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:24.629096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:24.650476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:24.651396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:24.652266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:24.652266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:24.652266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:24.652266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:24.654712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 358/733] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:24.663093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:24.682480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:24.683291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.683575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.683849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.706723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:24.708177 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:24.736776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:24.737731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:24.738611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:24.738611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:24.738611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:24.738611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:24.746831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 376/734] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:24.757630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:24.781631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b250b7-7e39-474c-b604-06c876c41498 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:24.822543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:24.856283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:24.857394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.857891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.858381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.859345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:24.859864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:24.861549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:24.889009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 359/735] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:24.893270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:24.901075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:24.949603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bccdd-52de-4b02-b3e4-ad0100613d3e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:24.989416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:24.991268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:24.991757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:24.992486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:24.993428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:24.993957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:24.995553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:25.014122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 377/736] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:25.016911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:25.092110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7acba7-be75-4aeb-bf18-a33fc7d0b815 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:25.127939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55523-78c4-4f77-8f35-e6a5478fcd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:25.129123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55523-78c4-4f77-8f35-e6a5478fcd28 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.129625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55523-78c4-4f77-8f35-e6a5478fcd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.130109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55523-78c4-4f77-8f35-e6a5478fcd28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.137859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a55523-78c4-4f77-8f35-e6a5478fcd28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:25.139616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a55523-78c4-4f77-8f35-e6a5478fcd28 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:25.146457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8a47b-06f0-4909-a7bd-2960314c395a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c3a55523-78c4-4f77-8f35-e6a5478fcd28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:25.155035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:25.155936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:25.156886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:25.156886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:25.156886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:25.156886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:25.156886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:25.156886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:25.156886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:25.156886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:25.159364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 360/737] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:25.161021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72365b9-d0fd-4297-bfa4-a336e6cd7e4c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.162133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72365b9-d0fd-4297-bfa4-a336e6cd7e4c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.162683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72365b9-d0fd-4297-bfa4-a336e6cd7e4c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.164741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 361/738] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:25.165760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72365b9-d0fd-4297-bfa4-a336e6cd7e4c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:25.172654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:25.188082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5693f-27c2-481c-bd47-eef042fea79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:25.201335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5693f-27c2-481c-bd47-eef042fea79b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.201335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5693f-27c2-481c-bd47-eef042fea79b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.201335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5693f-27c2-481c-bd47-eef042fea79b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.201335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5693f-27c2-481c-bd47-eef042fea79b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:25.201335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5693f-27c2-481c-bd47-eef042fea79b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-98f5693f-27c2-481c-bd47-eef042fea79b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:25.219851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:25.220884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 378/739] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d515d8-8af1-4afd-9e22-5d06a0ec52c0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.227045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d515d8-8af1-4afd-9e22-5d06a0ec52c0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.227759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d515d8-8af1-4afd-9e22-5d06a0ec52c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.245045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e5d515d8-8af1-4afd-9e22-5d06a0ec52c0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:25.246250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:25.247457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e5d515d8-8af1-4afd-9e22-5d06a0ec52c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:25.288144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72365b9-d0fd-4297-bfa4-a336e6cd7e4c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:25.337029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101b8c1-5cab-4066-976f-de97b74eefcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:25.337273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 379/740] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:25.337358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b8c1-5cab-4066-976f-de97b74eefcf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.337429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d515d8-8af1-4afd-9e22-5d06a0ec52c0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:25.337506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b8c1-5cab-4066-976f-de97b74eefcf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.337506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b8c1-5cab-4066-976f-de97b74eefcf None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.337506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b8c1-5cab-4066-976f-de97b74eefcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:25.337506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b8c1-5cab-4066-976f-de97b74eefcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:25.337506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b8c1-5cab-4066-976f-de97b74eefcf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:25.357864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 362/741] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:25.359799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fda8-3ebb-40ac-9155-38c7e7e75405 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.360095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fda8-3ebb-40ac-9155-38c7e7e75405 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.360401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fda8-3ebb-40ac-9155-38c7e7e75405 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.362277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 363/742] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:25.362997 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fda8-3ebb-40ac-9155-38c7e7e75405 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:25.421127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:25.441287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d515d8-8af1-4afd-9e22-5d06a0ec52c0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:25.476944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fda8-3ebb-40ac-9155-38c7e7e75405 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:25.477953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:25.478633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.478914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.479191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.480032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:25.480367 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:25.481808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:25.501611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 380/743] 10.222.0.123 () {56 vars in 1140 bytes} [Thu May 26 17:52:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:25.502421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:25.505667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:25.519408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0199cc-0ee9-408c-ba87-b891ee6be5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:25.520189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0199cc-0ee9-408c-ba87-b891ee6be5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.521728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0199cc-0ee9-408c-ba87-b891ee6be5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.521728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0199cc-0ee9-408c-ba87-b891ee6be5d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.531791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0199cc-0ee9-408c-ba87-b891ee6be5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4a0199cc-0ee9-408c-ba87-b891ee6be5d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:25.539858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:25.541005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:25.541935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 364/744] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:25.542602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074fad-5218-46d8-9fa6-dedd3530ad6c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.542602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074fad-5218-46d8-9fa6-dedd3530ad6c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.543153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074fad-5218-46d8-9fa6-dedd3530ad6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.560920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-20074fad-5218-46d8-9fa6-dedd3530ad6c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:25.562096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-20074fad-5218-46d8-9fa6-dedd3530ad6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:25.618061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c45cb0-6288-47ad-905d-8eb6121ea3c7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:25.638808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 365/745] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:25.640520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20074fad-5218-46d8-9fa6-dedd3530ad6c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:25.664782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:25.665740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.666228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.666727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.667901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=c786580d6b5d4e50afbb2ee7a32acadc) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:25.668421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:25.670043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:25.676018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 381/746] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:25 2022] GET /identity/v3/role_assignments?user.id=c786580d6b5d4e50afbb2ee7a32acadc&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:25.685497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:25.689173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:25.769114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20074fad-5218-46d8-9fa6-dedd3530ad6c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:25.790875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:25.823760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080b83b-c274-4f96-8f12-a19631ad6ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:25.824918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080b83b-c274-4f96-8f12-a19631ad6ffa None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.825797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080b83b-c274-4f96-8f12-a19631ad6ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.826697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080b83b-c274-4f96-8f12-a19631ad6ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.832748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d9a59-980c-4337-aad9-5bdd1c12ec64 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:25.887778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:25.888980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:25.889922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:25.890359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:25.891582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:25.892082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:25.894341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:25.907500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 382/747] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:25.908870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:25.919105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080b83b-c274-4f96-8f12-a19631ad6ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:25.920835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080b83b-c274-4f96-8f12-a19631ad6ffa None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:25.991697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:26.032228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0e9a-5110-408c-afc4-40ce0341ef30 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:26.053798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 366/748] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 17:52:26.054945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080b83b-c274-4f96-8f12-a19631ad6ffa None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:26.070151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119d057-6d0c-4b55-90e7-d5ac89b38257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:26.071097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119d057-6d0c-4b55-90e7-d5ac89b38257 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.071352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:26.071561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119d057-6d0c-4b55-90e7-d5ac89b38257 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.072203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119d057-6d0c-4b55-90e7-d5ac89b38257 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.072838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119d057-6d0c-4b55-90e7-d5ac89b38257 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:26.074306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119d057-6d0c-4b55-90e7-d5ac89b38257 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:26.158009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080b83b-c274-4f96-8f12-a19631ad6ffa None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:26.194173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8678a15-a7c0-4457-bbd6-2f33cf8659a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:26.194957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678a15-a7c0-4457-bbd6-2f33cf8659a8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.195235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678a15-a7c0-4457-bbd6-2f33cf8659a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.195507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678a15-a7c0-4457-bbd6-2f33cf8659a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.195921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 383/749] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:52:25 2022] POST /identity/v3/services => generated 252 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:26.196924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119d057-6d0c-4b55-90e7-d5ac89b38257 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:26.217264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8678a15-a7c0-4457-bbd6-2f33cf8659a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:26.218755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8678a15-a7c0-4457-bbd6-2f33cf8659a8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a8678a15-a7c0-4457-bbd6-2f33cf8659a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:26.242125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:26.243154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:26.244054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:26.244054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:26.244054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:26.244054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:26.244054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 367/750] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:26.245323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362432-605d-4167-b047-25e4130b6d76 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.245613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362432-605d-4167-b047-25e4130b6d76 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.245886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362432-605d-4167-b047-25e4130b6d76 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.251626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 368/751] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:26 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:26.253180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362432-605d-4167-b047-25e4130b6d76 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:26.359114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:26.370639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119d057-6d0c-4b55-90e7-d5ac89b38257 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:26.395475 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:26.419580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362432-605d-4167-b047-25e4130b6d76 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:26.419760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d751409-a7f3-4d5a-810b-40dfbede2424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:26.419760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d751409-a7f3-4d5a-810b-40dfbede2424 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.419760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d751409-a7f3-4d5a-810b-40dfbede2424 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.419760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d751409-a7f3-4d5a-810b-40dfbede2424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.432098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d751409-a7f3-4d5a-810b-40dfbede2424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:26.433796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d751409-a7f3-4d5a-810b-40dfbede2424 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:26.454216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:26.454871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.455148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4d751409-a7f3-4d5a-810b-40dfbede2424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:26.460693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:26.461587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:26.462452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:26.462452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:26.462452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:26.462452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:26.462664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.462664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:26.462664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:26.462855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 384/752] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:26.462922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:26.462988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249572-09c1-461f-ae1b-ef7c2f78559a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.462988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249572-09c1-461f-ae1b-ef7c2f78559a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.462988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68249572-09c1-461f-ae1b-ef7c2f78559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.471952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 369/753] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:26.473015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:26.476806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-68249572-09c1-461f-ae1b-ef7c2f78559a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:26.478436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-68249572-09c1-461f-ae1b-ef7c2f78559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:26.574346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 385/754] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:26 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 17:52:26.575354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68249572-09c1-461f-ae1b-ef7c2f78559a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:26.597200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e63cd4-efdd-4a4f-af06-51083587ab58 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:26.629673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:26.644336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:26.644336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.644336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.644336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.648858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:26.648858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:26.648858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:26.658002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 370/755] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:26.658960 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:26.691741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68249572-09c1-461f-ae1b-ef7c2f78559a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:26.694005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:26.736182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:26.737351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.737768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.738163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.746787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:26.748557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:26.764264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:26.765331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:26.766263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:26.767754 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596838b-3c77-48b2-b066-1346a608f7a0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:26.773539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 386/756] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:52:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:26.774662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:26.806408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca02d2-904b-440d-957d-bd4d38a1bbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:26.807057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca02d2-904b-440d-957d-bd4d38a1bbaa None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.807336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca02d2-904b-440d-957d-bd4d38a1bbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.807609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca02d2-904b-440d-957d-bd4d38a1bbaa None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.808352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca02d2-904b-440d-957d-bd4d38a1bbaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:26.809735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca02d2-904b-440d-957d-bd4d38a1bbaa None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:26.903165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddc7a4-5145-4250-a704-54172f2aec18 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:26.909630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 371/757] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:52:26 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:26.914694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca02d2-904b-440d-957d-bd4d38a1bbaa None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:26.954355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:26.956117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:26.956732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:26.957224 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:26.965840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:26.967641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:26.984606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:26.985563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:26.986441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:26.986441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:26.986441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:26.986441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:26.986441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:26.986441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:26.986441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:26.986441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:26.989557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 387/758] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:26.997828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:27.043969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:27.071491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:27.223940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc000f-cbeb-42a7-91b2-6b4af3c481c4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:27.233211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca02d2-904b-440d-957d-bd4d38a1bbaa None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:27.282758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:27.283435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.283719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.285867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.285867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:27.285867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:27.287209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:27.328326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:27.328535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.332325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.332325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.332325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:27.332325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:27.332325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:27.338782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 372/759] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:52:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:27.344324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:27.362980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 388/760] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:27.368324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:27.524496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:27.526661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc605-5805-4601-94cb-f3d721fb6365 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:27.534066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:27.567614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9824ab-77cd-4af0-923e-98e995d43ae3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:27.611212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:27.612009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.612293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.612586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.633455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:27.634936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:27.649277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:27.650076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.650439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.650713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.651550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=a2fbee9630954680bcec917996319e3a) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:27.651863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:27.654538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:27.667493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:27.669709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:27.670934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:27.670934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:27.670934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:27.670934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:27.670934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 373/761] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:27.672116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 389/762] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:27 2022] GET /identity/v3/role_assignments?user.id=a2fbee9630954680bcec917996319e3a&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 260 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:27.678087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:27.847080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113728b-52e8-4966-8618-6bbc6d4d1ec2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:27.901834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906cedb-07b9-40cb-956d-121cc4d9923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:27.902522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906cedb-07b9-40cb-956d-121cc4d9923b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:27.902801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906cedb-07b9-40cb-956d-121cc4d9923b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:27.903075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906cedb-07b9-40cb-956d-121cc4d9923b None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:27.903829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906cedb-07b9-40cb-956d-121cc4d9923b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:27.904136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906cedb-07b9-40cb-956d-121cc4d9923b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:27.905640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906cedb-07b9-40cb-956d-121cc4d9923b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:27.923767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 374/763] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:27.929659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:28.085329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5253f23-f6da-4464-b04c-2ff7f821a533 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:28.090673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915573-243f-47c8-bb83-c297ea52f61d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.090959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915573-243f-47c8-bb83-c297ea52f61d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.091235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915573-243f-47c8-bb83-c297ea52f61d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.092887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 375/764] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:28.098334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30af73c-7fcd-4c0d-95cd-76ff074d714e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.098653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30af73c-7fcd-4c0d-95cd-76ff074d714e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.098941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30af73c-7fcd-4c0d-95cd-76ff074d714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.117425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d30af73c-7fcd-4c0d-95cd-76ff074d714e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:28.120458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d30af73c-7fcd-4c0d-95cd-76ff074d714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:28.130999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:28.165687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:28.166508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.166791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.167068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.174613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:28.176079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:28.191902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:28.193598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:28.194619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:28.194619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:28.194619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:28.194619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:28.194619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:28.194619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:28.194619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:28.194619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:28.195199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 390/765] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:28.202237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:28.214196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:28.236656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 376/766] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:28 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:28.273853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30af73c-7fcd-4c0d-95cd-76ff074d714e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:28.383686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad5b03-24dd-4a89-b9dd-a6ad2481d534 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:28.452234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:28.452952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.453234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.453509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.454295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:28.454604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:28.456042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:28.469056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 391/767] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:28.475039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30af73c-7fcd-4c0d-95cd-76ff074d714e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:28.477210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:28.513719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc81e5-7915-4f4e-83f3-1f8bd57037bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:28.514661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc81e5-7915-4f4e-83f3-1f8bd57037bd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.514967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc81e5-7915-4f4e-83f3-1f8bd57037bd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.515312 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc81e5-7915-4f4e-83f3-1f8bd57037bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.527877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc81e5-7915-4f4e-83f3-1f8bd57037bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a5bc81e5-7915-4f4e-83f3-1f8bd57037bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:28.537204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:28.538394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:28.539376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 377/768] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:28.545383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc81e5-7915-4f4e-83f3-1f8bd57037bd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:28.601337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:28.656885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc81e5-7915-4f4e-83f3-1f8bd57037bd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:28.672842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:28.707414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94687e-4d4e-41ec-ab2f-1e191dfb8428 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:28.749236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019119c-19bc-4b1f-9145-e77c476fe698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:28.750170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019119c-19bc-4b1f-9145-e77c476fe698 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.750454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019119c-19bc-4b1f-9145-e77c476fe698 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.750731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019119c-19bc-4b1f-9145-e77c476fe698 None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/6fd75bf129c642a89153efcb584406d8/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.753873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019119c-19bc-4b1f-9145-e77c476fe698 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=6fd75bf129c642a89153efcb584406d8, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:28.755378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019119c-19bc-4b1f-9145-e77c476fe698 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:28.762777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:28.763462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.763746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.764022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.764813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:28.765125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:28.766526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:28.778304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 378/769] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:28 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:28.783418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:28.854925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 392/770] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:28 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/6fd75bf129c642a89153efcb584406d8/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:28.863124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:28.912040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc9c7-40a5-40bc-a554-2f96b65de7ab None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:28.953689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5d6d3-5379-48dd-99a1-853817ce4458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:28.954493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d6d3-5379-48dd-99a1-853817ce4458 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.954775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d6d3-5379-48dd-99a1-853817ce4458 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.955050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5d6d3-5379-48dd-99a1-853817ce4458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:28.967480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5d6d3-5379-48dd-99a1-853817ce4458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:28.969078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5d6d3-5379-48dd-99a1-853817ce4458 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c9d5d6d3-5379-48dd-99a1-853817ce4458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:28.988342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:28.989274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:28.990920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:28.990920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:28.990920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:28.990920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:28.990920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 379/771] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:28.998746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019119c-19bc-4b1f-9145-e77c476fe698 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:28.999410 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9245438-2019-4468-ab90-84d6b6c6d6b7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:28.999705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9245438-2019-4468-ab90-84d6b6c6d6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:28.999982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9245438-2019-4468-ab90-84d6b6c6d6b7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.001646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 380/772] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:29.011813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f0a42-45eb-4c4d-be93-0fc38a4a6fb0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:29.012146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f0a42-45eb-4c4d-be93-0fc38a4a6fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:29.012373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f0a42-45eb-4c4d-be93-0fc38a4a6fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.045781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2e7f0a42-45eb-4c4d-be93-0fc38a4a6fb0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:29.047002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e7f0a42-45eb-4c4d-be93-0fc38a4a6fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:29.133820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 381/773] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:29 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:29.153880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019119c-19bc-4b1f-9145-e77c476fe698 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:29.158627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f0a42-45eb-4c4d-be93-0fc38a4a6fb0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:29.189184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:29.203357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:29.204375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:29.209020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:29.209020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.209020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:29.209020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:29.209020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:29.222925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 393/774] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:29.228798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:29.261797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:29.344096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f0a42-45eb-4c4d-be93-0fc38a4a6fb0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:29.383594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:29.384435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:29.384719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:29.384996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.385653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:29.387194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:29.403695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:29.404701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:29.405526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 382/775] 10.222.0.123 () {56 vars in 1134 bytes} [Thu May 26 17:52:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:29.406963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024420b-5a55-48d5-aa23-10e0e1f92a84 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:29.411031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:29.453316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:29.454479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:29.454957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:29.455442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.465612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:29.467973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:29.490799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:29.491861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:29.492818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:29.497969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 394/776] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:52:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:29.505092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:29.567500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:29.612403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c89ce-441f-461e-b4c8-7c73937ebe69 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:29.627655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0e5e-745f-46a7-ad4d-4abd17f60f94 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:29.645582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:29.671202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:29.672241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:29.672909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:29.674416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.675483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:29.676663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:29.679673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:29.698952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:29.700010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:29.700593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:29.701072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.702014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:29.702535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:29.704240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:29.715026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 395/777] 10.222.0.123 () {56 vars in 1154 bytes} [Thu May 26 17:52:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:29.727102 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 383/778] 10.222.0.123 () {56 vars in 1129 bytes} [Thu May 26 17:52:29 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:29.728390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:29.733357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:29.859240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bccf55-fb03-4b53-8b6c-34283f762529 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:29.898106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be3fbe-ab86-4c75-87ec-5e42d5f2caed None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:29.902540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:29.903783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:29.905946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:29.906445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.907408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:29.909202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:29.909939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:29.911560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:29.932360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 384/779] 10.222.0.123 () {56 vars in 1129 bytes} [Thu May 26 17:52:29 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:29.944834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:29.954621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:29.955733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:29.956235 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:29.956754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:29.968809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:29.970919 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:29.991495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:29.992451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:29.993333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:29.993333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:29.993333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:29.993333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:29.995565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 396/780] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:30.001218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:30.036822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:30.115732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33ad3-d3f7-4f53-83a6-4d190787e41f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:30.117295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405da98-fcb5-4f87-92c1-a9e53eaf0b96 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:30.157604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2fe25-eef9-481a-89c8-733feb2f440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:30.158843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2fe25-eef9-481a-89c8-733feb2f440a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.159341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2fe25-eef9-481a-89c8-733feb2f440a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.159825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2fe25-eef9-481a-89c8-733feb2f440a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.161036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2fe25-eef9-481a-89c8-733feb2f440a None admin] RBAC: Adding query filter params (interface=public, service_id=6f3e007ca719467081370a518b2c97d5, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:30.161620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2fe25-eef9-481a-89c8-733feb2f440a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:30.164517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2fe25-eef9-481a-89c8-733feb2f440a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:30.164705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:30.165346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.165724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.166068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.166895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:30.167296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:30.169325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:30.183504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 385/781] 10.222.0.123 () {56 vars in 1256 bytes} [Thu May 26 17:52:29 2022] GET /identity/v3/endpoints?service_id=6f3e007ca719467081370a518b2c97d5&interface=public®ion_id=RegionOne => generated 195 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:30.185549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294873b0-65bc-4003-9b75-75359106dcb8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.186079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294873b0-65bc-4003-9b75-75359106dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.186537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294873b0-65bc-4003-9b75-75359106dcb8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.188055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 397/782] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:30.188437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 386/783] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:30.194921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294873b0-65bc-4003-9b75-75359106dcb8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:30.195301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:30.217240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:30.320947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294873b0-65bc-4003-9b75-75359106dcb8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:30.328729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:30.331958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8ffb2-81a6-4fe2-99e8-057939843ca3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:30.357199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0c44c-a1f0-4ea6-a2fb-1fb12e218242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:30.358396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0c44c-a1f0-4ea6-a2fb-1fb12e218242 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.358879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0c44c-a1f0-4ea6-a2fb-1fb12e218242 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.359352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0c44c-a1f0-4ea6-a2fb-1fb12e218242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.367511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0c44c-a1f0-4ea6-a2fb-1fb12e218242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:30.369500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0c44c-a1f0-4ea6-a2fb-1fb12e218242 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:30.370946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab49f08-b3c9-4a1c-b99e-fd94291d9bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:30.371737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49f08-b3c9-4a1c-b99e-fd94291d9bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.372143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49f08-b3c9-4a1c-b99e-fd94291d9bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.372450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab49f08-b3c9-4a1c-b99e-fd94291d9bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.373134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab49f08-b3c9-4a1c-b99e-fd94291d9bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:30.374501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab49f08-b3c9-4a1c-b99e-fd94291d9bc0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:30.380057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 398/784] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:52:30 2022] GET /identity/v3/services => generated 776 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:30.383992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b328-400d-4ddc-8554-ebf9fb59af6f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.383992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b328-400d-4ddc-8554-ebf9fb59af6f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.383992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b328-400d-4ddc-8554-ebf9fb59af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-81d0c44c-a1f0-4ea6-a2fb-1fb12e218242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:30.384688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:30.385551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:30.386468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 387/785] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:30.387378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176037-8ba4-4653-a516-51c1cd21cc2e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.388059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176037-8ba4-4653-a516-51c1cd21cc2e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.388059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176037-8ba4-4653-a516-51c1cd21cc2e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.389476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 388/786] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:30.391268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6176037-8ba4-4653-a516-51c1cd21cc2e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:30.406337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9dd0b328-400d-4ddc-8554-ebf9fb59af6f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:30.407806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9dd0b328-400d-4ddc-8554-ebf9fb59af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:30.492960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 399/787] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:30 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:30.494878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98557207-8c1b-4a7e-834a-0e6a3cbcf422 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.495380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98557207-8c1b-4a7e-834a-0e6a3cbcf422 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.495835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98557207-8c1b-4a7e-834a-0e6a3cbcf422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.508710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:30.515878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-98557207-8c1b-4a7e-834a-0e6a3cbcf422 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:30.517673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-98557207-8c1b-4a7e-834a-0e6a3cbcf422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:30.542146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6176037-8ba4-4653-a516-51c1cd21cc2e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:30.588632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:30.589319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.589591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.589867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.590966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:30.591276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:30.593035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:30.609357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 389/788] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:30.610083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:30.616323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 400/789] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:30 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:30.617018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98557207-8c1b-4a7e-834a-0e6a3cbcf422 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:30.650536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:30.736093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e956a-1c84-49cf-8346-9638d8ebdb67 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:30.749063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98557207-8c1b-4a7e-834a-0e6a3cbcf422 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:30.775142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:30.776419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.776897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.777372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] PATH_INFO: `/v3/services/network` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.778309 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:30.779928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:30.786618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decef69-94f9-462c-a5e7-e8c4e345d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:30.788104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decef69-94f9-462c-a5e7-e8c4e345d5bc None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.788409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decef69-94f9-462c-a5e7-e8c4e345d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.788682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decef69-94f9-462c-a5e7-e8c4e345d5bc None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/c786580d6b5d4e50afbb2ee7a32acadc/roles/a9ef6ba6c6a94fc7bcb5d8b628725987` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.792068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:30.795761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:30.796731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:30.797550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:30.800388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 390/790] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:30 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:30.801466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:30.809898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decef69-94f9-462c-a5e7-e8c4e345d5bc None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=c786580d6b5d4e50afbb2ee7a32acadc, role_id=a9ef6ba6c6a94fc7bcb5d8b628725987)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:30.811353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decef69-94f9-462c-a5e7-e8c4e345d5bc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:30.900518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:30.910683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a50989-29bf-4c17-9060-d0ab20cebd25 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:30.924729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 401/791] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:30 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/c786580d6b5d4e50afbb2ee7a32acadc/roles/a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:30.926319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decef69-94f9-462c-a5e7-e8c4e345d5bc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:30.977694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a500-5389-4342-b840-c87710301f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:30.978506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a500-5389-4342-b840-c87710301f23 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:30.978781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a500-5389-4342-b840-c87710301f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:30.979049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a500-5389-4342-b840-c87710301f23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:30.993116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13a500-5389-4342-b840-c87710301f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ae13a500-5389-4342-b840-c87710301f23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:31.002775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:31.003745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:31.005050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:31.008973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 391/792] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:31.019125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a500-5389-4342-b840-c87710301f23 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.106093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decef69-94f9-462c-a5e7-e8c4e345d5bc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.166048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.166825 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.167023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.167260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.167968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] RBAC: Adding query filter params (name=network) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:31.168275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:31.169679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:31.175432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 402/793] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:30 2022] GET /identity/v3/services?name=network => generated 125 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:31.183140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.207030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a500-5389-4342-b840-c87710301f23 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.249879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:31.254010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.254697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.255053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.255419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.257187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:31.257645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:31.259115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:31.270195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 392/794] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:31.277961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.301013 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:31.339871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9cf9-1783-442d-b764-0a46b7d40d32 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.404171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edf4e3-e149-430f-b1e4-e013710296cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.404865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edf4e3-e149-430f-b1e4-e013710296cb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.405144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edf4e3-e149-430f-b1e4-e013710296cb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.405418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edf4e3-e149-430f-b1e4-e013710296cb None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.406126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edf4e3-e149-430f-b1e4-e013710296cb None admin] RBAC: Adding query filter params (type=network) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:31.406430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edf4e3-e149-430f-b1e4-e013710296cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:31.407797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edf4e3-e149-430f-b1e4-e013710296cb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:31.420373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 403/795] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/services?type=network => generated 352 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:31.422718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef59dc-6232-4efb-a868-e417526eb22f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.423007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef59dc-6232-4efb-a868-e417526eb22f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.423283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef59dc-6232-4efb-a868-e417526eb22f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.427505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 404/796] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:31 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:31.428341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef59dc-6232-4efb-a868-e417526eb22f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.450788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9633e-dc79-4d1e-b957-bda9b635dd1f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.492967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19622-0cd6-4f4e-a57c-811e45d5286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.493804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19622-0cd6-4f4e-a57c-811e45d5286e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.494331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19622-0cd6-4f4e-a57c-811e45d5286e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.494625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19622-0cd6-4f4e-a57c-811e45d5286e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.509337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc19622-0cd6-4f4e-a57c-811e45d5286e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:31.511575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc19622-0cd6-4f4e-a57c-811e45d5286e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ffc19622-0cd6-4f4e-a57c-811e45d5286e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:31.535048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:31.535959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:31.540331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:31.540331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:31.540331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:31.540331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:31.540981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 393/797] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:31.543036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb415-b403-4071-8ea1-4adbea010fec None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.543036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb415-b403-4071-8ea1-4adbea010fec None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.543205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb415-b403-4071-8ea1-4adbea010fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.565311 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-376eb415-b403-4071-8ea1-4adbea010fec None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:31.566979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-376eb415-b403-4071-8ea1-4adbea010fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:31.568966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef59dc-6232-4efb-a868-e417526eb22f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.584382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:31.605859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.606549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.606836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.607114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.607902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] RBAC: Adding query filter params (interface=public, service_id=fc896e6cd3824573a328955c64c216f0, region_id=RegionOne) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:31.608225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:31.609789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:31.619623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 405/798] 10.222.0.123 () {56 vars in 1256 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/endpoints?service_id=fc896e6cd3824573a328955c64c216f0&interface=public®ion_id=RegionOne => generated 195 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:31.620698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.640715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:31.649365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 394/799] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:31 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:31.653292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eb415-b403-4071-8ea1-4adbea010fec None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.754218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba687d-f5fb-4b8b-a4da-e8bd4c5074aa None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.767449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376eb415-b403-4071-8ea1-4adbea010fec None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.791305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.791981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.792264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.792585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.793481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:31.793836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:31.795179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:31.808516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4ae9-a763-4026-8fae-534ae18f4770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.809584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4ae9-a763-4026-8fae-534ae18f4770 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.810071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4ae9-a763-4026-8fae-534ae18f4770 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.810585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4ae9-a763-4026-8fae-534ae18f4770 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.811585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4ae9-a763-4026-8fae-534ae18f4770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:31.813095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 406/800] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:31.813499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a4ae9-a763-4026-8fae-534ae18f4770 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:31.814070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.821902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 395/801] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/services => generated 776 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:31.823075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4ae9-a763-4026-8fae-534ae18f4770 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:31.859080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:31.894823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:31.928053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6c7f-00b2-4955-a748-46033a1b22f0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.942504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a4ae9-a763-4026-8fae-534ae18f4770 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:31.967343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d923b2-187e-4bac-82d3-0b55e7022085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.968160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d923b2-187e-4bac-82d3-0b55e7022085 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.968493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d923b2-187e-4bac-82d3-0b55e7022085 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.968771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d923b2-187e-4bac-82d3-0b55e7022085 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:31.981422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d923b2-187e-4bac-82d3-0b55e7022085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:31.987924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:31.988996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-22d923b2-187e-4bac-82d3-0b55e7022085 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:31.989210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:31.990168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:31.991781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 407/802] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:31.993060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:31.993060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:32.000346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d923b2-187e-4bac-82d3-0b55e7022085 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:32.021299 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:32.023612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:32.052232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:32.053625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:32.054789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:32.060426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 396/803] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:32.071208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:32.148062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:32.152035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d923b2-187e-4bac-82d3-0b55e7022085 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:32.200440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:32.202250 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:32.202850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:32.203385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:32.204628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:32.205547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:32.207526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:32.216839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320f503-0ae8-4b84-b2bd-86b116a6be1d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:32.222081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 408/804] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:32.229200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:32.256649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:32.293140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:32.293724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:32.294447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:32.294729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:32.296684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:32.297007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:32.298471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:32.340333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 397/805] 10.222.0.123 () {56 vars in 1140 bytes} [Thu May 26 17:52:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:32.343939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:32.431067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933cec8-befb-4460-84d7-bf7a15133167 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:32.517638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:32.518451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:32.518724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:32.518991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:32.519100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbc676-029a-4382-9858-0bcf4251eb96 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:32.547107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:32.548517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:32.562217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:32.563010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:32.563294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:32.563569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:32.584009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:32.585158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:32.586366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:32.586366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:32.586366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:32.586366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:32.586366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 409/806] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:32.592430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:32.592581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:32.594168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:32.619629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:32.637791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:32.639545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:32.640719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:32.640719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:32.640719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:32.640719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:32.640719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 398/807] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:32.646858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:32.710140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f28f1e-20c7-4430-8169-e331a0a68e02 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:32.721317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:32.750971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:32.751663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:32.751947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:32.752223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:32.752989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:32.753306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:32.754729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:32.788218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 410/808] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:32.789862 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:32.872740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:32.898136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd061d4-ceba-4540-abc0-5235124def46 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:32.906538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86ab01-c00b-465b-bcef-5f4743a05233 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:32.935636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634209a-d876-4715-a539-8d02e030930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:32.936561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634209a-d876-4715-a539-8d02e030930b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:32.936913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634209a-d876-4715-a539-8d02e030930b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:32.937255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634209a-d876-4715-a539-8d02e030930b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:32.945507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634209a-d876-4715-a539-8d02e030930b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:32.947040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634209a-d876-4715-a539-8d02e030930b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a634209a-d876-4715-a539-8d02e030930b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:32.963426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:32.964697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:52:32.965853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:32.966660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 411/809] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:52:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:32.972536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634209a-d876-4715-a539-8d02e030930b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.003530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ee266-3332-4ae2-bc23-59e104ab2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:33.004183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee266-3332-4ae2-bc23-59e104ab2f47 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.004499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee266-3332-4ae2-bc23-59e104ab2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.004773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ee266-3332-4ae2-bc23-59e104ab2f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.005487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ee266-3332-4ae2-bc23-59e104ab2f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:33.005903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ee266-3332-4ae2-bc23-59e104ab2f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:33.007839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ee266-3332-4ae2-bc23-59e104ab2f47 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:33.019533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 399/810] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:33.020884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8ad6-e0ff-4753-8190-2110a001d542 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.021199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8ad6-e0ff-4753-8190-2110a001d542 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.021560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8ad6-e0ff-4753-8190-2110a001d542 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.026852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 400/811] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:33.027634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8ad6-e0ff-4753-8190-2110a001d542 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.103450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634209a-d876-4715-a539-8d02e030930b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:33.132828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8ad6-e0ff-4753-8190-2110a001d542 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:33.134311 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:33.144331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:33.149301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d5c4b-b262-407e-a8a1-ee82199d8c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:33.150510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d5c4b-b262-407e-a8a1-ee82199d8c95 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.150900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d5c4b-b262-407e-a8a1-ee82199d8c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.151290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d5c4b-b262-407e-a8a1-ee82199d8c95 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.152237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d5c4b-b262-407e-a8a1-ee82199d8c95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:33.152675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d5c4b-b262-407e-a8a1-ee82199d8c95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:33.154996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d5c4b-b262-407e-a8a1-ee82199d8c95 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:33.167556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:33.168662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.169151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.169519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.176626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:33.178169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:33.183008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 412/812] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:52:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:33.185208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080ccc2-0c2d-45fb-aa32-a4ebb918814d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.185620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080ccc2-0c2d-45fb-aa32-a4ebb918814d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.186049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080ccc2-0c2d-45fb-aa32-a4ebb918814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:33.195642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:33.196923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:33.198005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 401/813] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:33.198567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.207692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5080ccc2-0c2d-45fb-aa32-a4ebb918814d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:33.210183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5080ccc2-0c2d-45fb-aa32-a4ebb918814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:33.300532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 413/814] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:33 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:33.301543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080ccc2-0c2d-45fb-aa32-a4ebb918814d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.352361 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f314e-91af-424b-88ea-7ba0ad95edba None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:33.387475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f447c3-3a9b-47a8-a244-ad0c7a183a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:33.388443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f447c3-3a9b-47a8-a244-ad0c7a183a71 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.388900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f447c3-3a9b-47a8-a244-ad0c7a183a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.389371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f447c3-3a9b-47a8-a244-ad0c7a183a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.415243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080ccc2-0c2d-45fb-aa32-a4ebb918814d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:33.420720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:33.439517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:33.455582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:33.456266 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.456557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.456838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.457630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:33.457942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:33.460039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:33.463868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f447c3-3a9b-47a8-a244-ad0c7a183a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:33.465702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f447c3-3a9b-47a8-a244-ad0c7a183a71 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:33.473042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 414/815] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:33.474220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.590930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28946d4a-61ba-42de-833c-dbbeee84acf4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:33.622403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 402/816] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:33 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:52:33.623288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f447c3-3a9b-47a8-a244-ad0c7a183a71 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.633961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:33.634776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.635114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.635391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.636046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:33.637549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:33.650785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:33.651705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:33.652581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 415/817] 10.222.0.123 () {56 vars in 1134 bytes} [Thu May 26 17:52:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:33.653395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.680687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:33.701865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:33.745776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f447c3-3a9b-47a8-a244-ad0c7a183a71 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:33.763702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21aba0-3ef3-42d2-865d-351225fdc943 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:33.786469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef74be-8cf4-4e2e-80ee-fd8c99f9698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:33.788042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef74be-8cf4-4e2e-80ee-fd8c99f9698a None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.788042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef74be-8cf4-4e2e-80ee-fd8c99f9698a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.788462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef74be-8cf4-4e2e-80ee-fd8c99f9698a None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/a2fbee9630954680bcec917996319e3a/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.791055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef74be-8cf4-4e2e-80ee-fd8c99f9698a None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=a2fbee9630954680bcec917996319e3a, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:33.792921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef74be-8cf4-4e2e-80ee-fd8c99f9698a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:33.806046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:33.808539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.808539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.808539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.819281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:33.820789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:33.839114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:33.840793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:33.842374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:33.842374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:33.842374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:33.842374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:33.842374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 416/818] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:33.842374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.860967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 403/819] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:33 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/a2fbee9630954680bcec917996319e3a/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:33.862680 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac962-8c92-4fba-9f4c-2538822d58d5 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:33.862970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac962-8c92-4fba-9f4c-2538822d58d5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:33.863247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac962-8c92-4fba-9f4c-2538822d58d5 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:33.868368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 404/820] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:33.868368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac962-8c92-4fba-9f4c-2538822d58d5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:33.995406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:34.003644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d319f6-bc46-448f-85be-e22d8596e65f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.015398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac962-8c92-4fba-9f4c-2538822d58d5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.030228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:34.050452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f671-a6c3-4ee3-9a79-7b819a2931f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.051462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f671-a6c3-4ee3-9a79-7b819a2931f5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.051918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f671-a6c3-4ee3-9a79-7b819a2931f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.052397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f671-a6c3-4ee3-9a79-7b819a2931f5 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.054153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2f671-a6c3-4ee3-9a79-7b819a2931f5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:34.054666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2f671-a6c3-4ee3-9a79-7b819a2931f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:34.056373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2f671-a6c3-4ee3-9a79-7b819a2931f5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:34.062062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 417/821] 10.222.0.123 () {56 vars in 1129 bytes} [Thu May 26 17:52:33 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:34.064335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e052-fd6d-4532-ae28-01647f243fe5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.064817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e052-fd6d-4532-ae28-01647f243fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.065275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e052-fd6d-4532-ae28-01647f243fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.065396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.066410 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.066766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.067209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.068056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:34.069039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:34.070676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:34.087223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ad09e052-fd6d-4532-ae28-01647f243fe5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:34.087783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 405/822] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:34.088739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:34.089287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ad09e052-fd6d-4532-ae28-01647f243fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:34.169517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 418/823] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:34 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:34.170821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09e052-fd6d-4532-ae28-01647f243fe5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:34.234456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae301f-7430-47d2-8503-22991a7ec08b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.275944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:34.285926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.286709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.287587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.287875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.288631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:34.294167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:34.294310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09e052-fd6d-4532-ae28-01647f243fe5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.294408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:34.300426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 406/824] 10.222.0.123 () {56 vars in 1129 bytes} [Thu May 26 17:52:34 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:34.301850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:34.338258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.339329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.339716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.340092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.346350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:34.348022 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:34.350221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:34.364910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:34.366613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:34.367709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:34.367709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:34.367709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:34.367709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:34.367709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:34.367709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:34.367709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:34.367709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:34.369606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 419/825] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:34.370653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:34.437748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f3aa-2cd8-4e80-8f05-8eaf2a2b59a9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.479756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65832807-4492-4c49-8a74-01d5af57a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.480856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65832807-4492-4c49-8a74-01d5af57a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.481132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65832807-4492-4c49-8a74-01d5af57a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.481420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65832807-4492-4c49-8a74-01d5af57a0a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.492107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277bce8-90f0-4f38-bd05-4670cb30fd5d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.492803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65832807-4492-4c49-8a74-01d5af57a0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-65832807-4492-4c49-8a74-01d5af57a0a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:34.500553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:34.501465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:34.502279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 407/826] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:34.502938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65832807-4492-4c49-8a74-01d5af57a0a8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:34.530281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c53a-39db-4fd1-9005-bf78f0ae19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.530892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c53a-39db-4fd1-9005-bf78f0ae19ae None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.531172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c53a-39db-4fd1-9005-bf78f0ae19ae None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.531446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c53a-39db-4fd1-9005-bf78f0ae19ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.532176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c53a-39db-4fd1-9005-bf78f0ae19ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:34.533576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c53a-39db-4fd1-9005-bf78f0ae19ae None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:34.600712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:34.609128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65832807-4492-4c49-8a74-01d5af57a0a8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.642499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.643145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.643423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.643694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.644497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:34.644806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:34.646929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:34.664053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 420/827] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:52:34 2022] POST /identity/v3/endpoints => generated 348 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:34.664053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd7ef-0806-4057-a875-38e3c6d0972d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.664053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd7ef-0806-4057-a875-38e3c6d0972d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.664053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd7ef-0806-4057-a875-38e3c6d0972d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.664053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 421/828] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:34.664053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dd7ef-0806-4057-a875-38e3c6d0972d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:34.665019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 408/829] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:34.666570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:34.684552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:34.802027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930a9b-9246-4f07-9118-467879c633b6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.843738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dd7ef-0806-4057-a875-38e3c6d0972d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:34.844677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d7c8f-e0d6-460e-91c3-a5e63e406e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.845644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d7c8f-e0d6-460e-91c3-a5e63e406e81 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.846079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d7c8f-e0d6-460e-91c3-a5e63e406e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.846598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d7c8f-e0d6-460e-91c3-a5e63e406e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.847589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d7c8f-e0d6-460e-91c3-a5e63e406e81 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=6fd75bf129c642a89153efcb584406d8) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:34.848067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d7c8f-e0d6-460e-91c3-a5e63e406e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:34.850334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d7c8f-e0d6-460e-91c3-a5e63e406e81 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:34.857816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 409/830] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:34 2022] GET /identity/v3/role_assignments?user.id=6fd75bf129c642a89153efcb584406d8&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 610 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:34.859372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc798cd-60d9-46c8-b3c9-fc81369329d3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.859790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc798cd-60d9-46c8-b3c9-fc81369329d3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.860232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc798cd-60d9-46c8-b3c9-fc81369329d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.879710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3fc798cd-60d9-46c8-b3c9-fc81369329d3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:34.882616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3fc798cd-60d9-46c8-b3c9-fc81369329d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:34.897408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:34.911987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:34.914059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:34.914503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:34.915167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:34.916586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:34.917318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:34.919465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:34.938072 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 422/831] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:52:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:34.939930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:34.984550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 410/832] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:34 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:35.012169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc798cd-60d9-46c8-b3c9-fc81369329d3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:35.015458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:35.064649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c521-fb9c-4f6e-8ef7-2044bab97265 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.121107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.121923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.122201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.122474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.142568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc798cd-60d9-46c8-b3c9-fc81369329d3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.146345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.147814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:35.172281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:35.173254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:35.174170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:35.174170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:35.174170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:35.174170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:35.176872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 423/833] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:35.184030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:35.197844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.198483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.199856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.199856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.199856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.201484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:35.214566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:35.215621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:35.216520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 411/834] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:35 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:35.221642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:35.236411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:35.304865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46be436-08d6-44f6-9cf5-69f1b31b79eb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.323981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:35.329931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f00f2-5e69-4f76-8045-3fa9f60cf4a9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.343824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.344886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.345376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.345855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.346775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:35.347282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.348919 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.361365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 424/835] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:35.369417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:35.373229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.373903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.374223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.374494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.375202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:35.375507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.376987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.384348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 412/836] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:35 2022] GET /identity/v3/services?name=network => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:35.389598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:35.489968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:35.520969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc2945-bb76-4317-a574-fd44149adde6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.524192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aaf32c-011e-493e-82fe-d47567dca12b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.558968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.559989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.568835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.568835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.569090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.569090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.569090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.569321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.570829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:35.575871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.577238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.579680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.581134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.587726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 413/837] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:35 2022] GET /identity/v3/services?type=network => generated 352 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:35.593982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:35.603978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:35.604971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:35.605916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:35.613625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 425/838] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:52:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:35.620144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:35.699597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a338df9-2bde-408b-873c-61b14ebba8d9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.703194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:35.736198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dd96d-ec26-40db-b175-63ba6ed0b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.736916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dd96d-ec26-40db-b175-63ba6ed0b449 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.737205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dd96d-ec26-40db-b175-63ba6ed0b449 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.737484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dd96d-ec26-40db-b175-63ba6ed0b449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.738226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dd96d-ec26-40db-b175-63ba6ed0b449 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.740880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dd96d-ec26-40db-b175-63ba6ed0b449 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.752648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:35.804579 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854375-fc20-4181-8047-ac70b21f413b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:35.833693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 414/839] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:52:35 2022] POST /identity/v3/endpoints => generated 329 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:52:35.856868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:35.857548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:35.857831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:35.858111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:35.858950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:35.859259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:35.860794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:35.890922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 426/840] 10.222.0.123 () {56 vars in 1154 bytes} [Thu May 26 17:52:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:35.898490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dd96d-ec26-40db-b175-63ba6ed0b449 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:36.041480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dd96d-ec26-40db-b175-63ba6ed0b449 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:36.088467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5891b49-d712-4af2-9cce-f7a696d9dcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:36.089110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5891b49-d712-4af2-9cce-f7a696d9dcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:36.089393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5891b49-d712-4af2-9cce-f7a696d9dcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:36.089676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5891b49-d712-4af2-9cce-f7a696d9dcf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:36.155127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:36.163612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5891b49-d712-4af2-9cce-f7a696d9dcf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:36.165121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5891b49-d712-4af2-9cce-f7a696d9dcf6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:36.289329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 415/841] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:35 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:52:36.295699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:36.409990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:36.422036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba64c8-90f6-4251-a5ad-ad6e64bfc1cc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:36.442721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60dc31-72ad-4f7c-b50e-78581f60db30 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:36.443891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60dc31-72ad-4f7c-b50e-78581f60db30 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:36.444400 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60dc31-72ad-4f7c-b50e-78581f60db30 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:36.446204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 416/842] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:36.456345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e2ca-ce5d-4e0e-96d8-dd3d3dd7e66b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:36.456345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e2ca-ce5d-4e0e-96d8-dd3d3dd7e66b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:36.456345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e2ca-ce5d-4e0e-96d8-dd3d3dd7e66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:36.461447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:36.462237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:36.462515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:36.462785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:36.471153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ac47e2ca-ce5d-4e0e-96d8-dd3d3dd7e66b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:36.472374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ac47e2ca-ce5d-4e0e-96d8-dd3d3dd7e66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:36.473214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:36.474826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:36.493560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:36.495295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:36.497048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:36.497048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:36.497048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:36.497048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:36.497048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 427/843] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:36.505463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:36.551805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 417/844] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:36 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:36.575885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47e2ca-ce5d-4e0e-96d8-dd3d3dd7e66b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:36.607669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:36.627877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300cc1-8918-4c9f-8ea0-9e43dbc91886 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:36.675649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:36.676464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:36.676750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:36.677466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:36.678439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:36.678742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:36.680460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:36.700397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 428/845] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:36.701875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:36.704082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47e2ca-ce5d-4e0e-96d8-dd3d3dd7e66b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:36.708614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:36.743007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fca68-e098-4b50-a9c4-be23a83a4f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:36.743907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fca68-e098-4b50-a9c4-be23a83a4f5d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:36.744188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fca68-e098-4b50-a9c4-be23a83a4f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:36.744495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fca68-e098-4b50-a9c4-be23a83a4f5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:36.756271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fca68-e098-4b50-a9c4-be23a83a4f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a09fca68-e098-4b50-a9c4-be23a83a4f5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:36.765767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:36.766689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:36.767670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 418/846] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:36.775104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fca68-e098-4b50-a9c4-be23a83a4f5d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:36.829993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e22b-8fef-424b-af75-2073bce23963 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:36.868069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:36.868895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:36.869185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:36.869461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:36.877690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:36.878476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:36.880230 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:36.895253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fca68-e098-4b50-a9c4-be23a83a4f5d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:36.900702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:36.901735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:36.902730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:36.902730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:36.902730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:36.902730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:36.902730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:36.902730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:36.902730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:36.902730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:36.907414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 429/847] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:36.908277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:36.937090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:36.938053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:36.938538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:36.939054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:36.940071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:36.940585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:36.942281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:36.952800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 419/848] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:36 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:36.961931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:36.982079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:37.034796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83eda6-78d2-4679-b0b4-d908b2fce79f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.072982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1acdcb-6520-47f3-b9c7-ab88cd6b1b5f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.083468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.084573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.085120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.085734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.087279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:37.088090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:37.090857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:37.109331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 430/849] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:37.110622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:37.112045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.112876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.113157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.113431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.130618 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:37.133363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:37.140784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:37.153059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:37.160269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:37.161168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:37.161168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:37.161168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:37.161168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:37.161775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 420/850] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:37.162916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:37.254452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356296e-6f4c-4e0b-bac4-72c308d5adae None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.278325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769ec4b-2fff-4fdb-8608-2b8bdd2dadf1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.290504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:37.310957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.311944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.312319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.313144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.314331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=c786580d6b5d4e50afbb2ee7a32acadc) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:37.314723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:37.316910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:37.321479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad16e9-59a4-441c-adcf-76b45cac7584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.322319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad16e9-59a4-441c-adcf-76b45cac7584 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.322754 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad16e9-59a4-441c-adcf-76b45cac7584 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.323237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad16e9-59a4-441c-adcf-76b45cac7584 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.324156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad16e9-59a4-441c-adcf-76b45cac7584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:37.324670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad16e9-59a4-441c-adcf-76b45cac7584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:37.331990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 431/851] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:37 2022] GET /identity/v3/role_assignments?user.id=c786580d6b5d4e50afbb2ee7a32acadc&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 610 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:37.332177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad16e9-59a4-441c-adcf-76b45cac7584 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:37.343691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 421/852] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:37.352823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:37.461522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c7e7-f6ea-475a-b56d-395c9667ea87 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.461872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c7e7-f6ea-475a-b56d-395c9667ea87 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.462156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c7e7-f6ea-475a-b56d-395c9667ea87 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.463951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 422/853] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:37.470097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c65c9-bb2f-410e-9b12-f6decddd5947 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.470523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c65c9-bb2f-410e-9b12-f6decddd5947 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.470902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c65c9-bb2f-410e-9b12-f6decddd5947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.472443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe93d-38ac-4722-b076-b63a62b4b8ec None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.490933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e94c65c9-bb2f-410e-9b12-f6decddd5947 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:37.492643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e94c65c9-bb2f-410e-9b12-f6decddd5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:37.511539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.512255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.512555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.512822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.521290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:37.523734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:37.545015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:37.547200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:37.548656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 432/854] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:52:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:37.555715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:37.566417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:37.589649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 423/855] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:37 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:37.615296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c65c9-bb2f-410e-9b12-f6decddd5947 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:37.628072 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:37.702923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e3c4-9801-4d58-bf9e-2ba8e2bc33ef None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.743583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c65c9-bb2f-410e-9b12-f6decddd5947 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.747506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.748183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.748496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.748769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.749602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:37.749908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:37.751345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:37.777596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 433/856] 10.222.0.123 () {56 vars in 1140 bytes} [Thu May 26 17:52:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:37.783014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:37.790992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.791793 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.792076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.792576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.793255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:37.796490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:37.809494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:37.810529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:37.811764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 424/857] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:37.816645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:37.875351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:37.909329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba28012-d149-4aaa-9cc3-a89bfc2d42b4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.912676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:37.924661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1c3d1-dbc3-431f-9ab2-bec97d7d9796 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:37.948905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507c50f-c9b0-4b85-b122-d3229a140ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.949569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507c50f-c9b0-4b85-b122-d3229a140ada None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.950297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507c50f-c9b0-4b85-b122-d3229a140ada None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.950568 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507c50f-c9b0-4b85-b122-d3229a140ada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.962698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e0565-4f1c-4f4b-a60d-2f9956ed2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:37.963574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e0565-4f1c-4f4b-a60d-2f9956ed2a0d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.963685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e0565-4f1c-4f4b-a60d-2f9956ed2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.963904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e0565-4f1c-4f4b-a60d-2f9956ed2a0d None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.964640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e0565-4f1c-4f4b-a60d-2f9956ed2a0d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:37.964955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e0565-4f1c-4f4b-a60d-2f9956ed2a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:37.966330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e0565-4f1c-4f4b-a60d-2f9956ed2a0d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:37.971759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 425/858] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:37 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:37.973021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00f6fe-0386-4574-bf3a-6257e6f9d6cd None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:37.973307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00f6fe-0386-4574-bf3a-6257e6f9d6cd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:37.973583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00f6fe-0386-4574-bf3a-6257e6f9d6cd None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:37.979655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 426/859] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:37 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:37.980524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00f6fe-0386-4574-bf3a-6257e6f9d6cd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.030795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507c50f-c9b0-4b85-b122-d3229a140ada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.032171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507c50f-c9b0-4b85-b122-d3229a140ada None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.088914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00f6fe-0386-4574-bf3a-6257e6f9d6cd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.105628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:38.126560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fed44-2ddb-4c9d-a81e-cb633ea7169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.127308 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fed44-2ddb-4c9d-a81e-cb633ea7169c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.127597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fed44-2ddb-4c9d-a81e-cb633ea7169c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.127881 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fed44-2ddb-4c9d-a81e-cb633ea7169c None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.128642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fed44-2ddb-4c9d-a81e-cb633ea7169c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:38.128955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fed44-2ddb-4c9d-a81e-cb633ea7169c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.130328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fed44-2ddb-4c9d-a81e-cb633ea7169c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.140335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 427/860] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:37 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:38.140335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41399f5-8658-46d6-a89d-2684ed121f94 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.140335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41399f5-8658-46d6-a89d-2684ed121f94 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.140335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41399f5-8658-46d6-a89d-2684ed121f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.151587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 434/861] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:37 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:52:38.152728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507c50f-c9b0-4b85-b122-d3229a140ada None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.156316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:38.162697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f41399f5-8658-46d6-a89d-2684ed121f94 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:38.164561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f41399f5-8658-46d6-a89d-2684ed121f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:38.260853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 428/862] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:38 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:38.279084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41399f5-8658-46d6-a89d-2684ed121f94 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.289452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507c50f-c9b0-4b85-b122-d3229a140ada None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.332345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.332614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.333296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.333296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.346735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.348174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:38.368525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:38.369614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:38.370674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:38.370674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:38.370674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:38.370674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:38.374285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 435/863] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:38.375135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.410049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41399f5-8658-46d6-a89d-2684ed121f94 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.423031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:38.450352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.451154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.451487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.451761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.452146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:38.452440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.454009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:38.468383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:38.476601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:38.477421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 429/864] 10.222.0.123 () {56 vars in 1137 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:38.478989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.511676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550366c2-8d74-45ea-906e-3ff1db0c74db None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.556595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.557660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.558889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.559329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.560231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:38.560709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.562242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.578562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 436/865] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:38.584692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.595458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572e4d-0bfe-4a45-95d5-dec8f9fb6be9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.635663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.636388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.636645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.636918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.637697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:38.638002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.640004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.648978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 430/866] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:38.651721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.699689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:38.711523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72db301-ff69-44c6-8b92-864996866202 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.729828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:38.749316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.750869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.751436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.751890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.761142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.763595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.778455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89f49-9f2c-49c3-99e5-5c4513a0bc9d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:38.780716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:38.781604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:38.782481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:38.782481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:38.782481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:38.782481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:38.782481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:38.782481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:38.782481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:38.782481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:38.786953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 437/867] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:38.789806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:38.818217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.819241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.819725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.820221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.821170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:38.821678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.823258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.828364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 431/868] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:38.908129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede38ef4-4945-499e-b420-d453e4584c5e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:38.952401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44809c-0a6b-406e-bb3a-1a901488d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:38.953083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44809c-0a6b-406e-bb3a-1a901488d385 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:38.953359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44809c-0a6b-406e-bb3a-1a901488d385 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:38.953628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44809c-0a6b-406e-bb3a-1a901488d385 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:38.954423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44809c-0a6b-406e-bb3a-1a901488d385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:38.954731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44809c-0a6b-406e-bb3a-1a901488d385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:38.956208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44809c-0a6b-406e-bb3a-1a901488d385 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:38.971428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 438/869] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:38.978295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:39.092651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f1c2-942f-45ec-bcb4-d6c5d310091d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:39.094081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:39.128057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92f96f-5ba5-44d0-ab9c-596a74b993d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:39.128731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92f96f-5ba5-44d0-ab9c-596a74b993d1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:39.129004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92f96f-5ba5-44d0-ab9c-596a74b993d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:39.129275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92f96f-5ba5-44d0-ab9c-596a74b993d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:39.130096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92f96f-5ba5-44d0-ab9c-596a74b993d1 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=a2fbee9630954680bcec917996319e3a) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:39.130402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92f96f-5ba5-44d0-ab9c-596a74b993d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:39.132405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92f96f-5ba5-44d0-ab9c-596a74b993d1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:39.140342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 432/870] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:38 2022] GET /identity/v3/role_assignments?user.id=a2fbee9630954680bcec917996319e3a&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:39.756431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edf33b-5224-421a-8ef5-4bbaad2624b5 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:39.756954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edf33b-5224-421a-8ef5-4bbaad2624b5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:39.756954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edf33b-5224-421a-8ef5-4bbaad2624b5 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:39.758874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 439/871] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:39.764089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5309-4edf-4d9e-b6c2-0785465e0072 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:39.764524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5309-4edf-4d9e-b6c2-0785465e0072 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:39.764694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5309-4edf-4d9e-b6c2-0785465e0072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:39.781519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0edc5309-4edf-4d9e-b6c2-0785465e0072 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:39.782694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0edc5309-4edf-4d9e-b6c2-0785465e0072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:39.850533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 433/872] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:39 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:39.873951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edf33b-5224-421a-8ef5-4bbaad2624b5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:39.914059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:39.985709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edf33b-5224-421a-8ef5-4bbaad2624b5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:40.022573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea629ae-048f-44fe-a045-06c575988676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:40.023305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea629ae-048f-44fe-a045-06c575988676 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.023582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea629ae-048f-44fe-a045-06c575988676 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.023851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea629ae-048f-44fe-a045-06c575988676 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.034533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea629ae-048f-44fe-a045-06c575988676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4ea629ae-048f-44fe-a045-06c575988676 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:40.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:40.044374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:40.045193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 440/873] 10.222.0.123 () {56 vars in 1125 bytes} [Thu May 26 17:52:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:40.050769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5309-4edf-4d9e-b6c2-0785465e0072 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:40.149626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:40.155908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5309-4edf-4d9e-b6c2-0785465e0072 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:40.191088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:40.192130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.192669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.193151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.194637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:40.195151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:40.196801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:40.205679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 434/874] 10.222.0.123 () {56 vars in 1120 bytes} [Thu May 26 17:52:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:40.212100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea629ae-048f-44fe-a045-06c575988676 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:40.328187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:40.335998 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea629ae-048f-44fe-a045-06c575988676 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:40.374457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6122911-2d36-490d-88ca-ce6a279dfa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:40.375279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6122911-2d36-490d-88ca-ce6a279dfa16 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.375560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6122911-2d36-490d-88ca-ce6a279dfa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.375831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6122911-2d36-490d-88ca-ce6a279dfa16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.389680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6122911-2d36-490d-88ca-ce6a279dfa16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:40.391145 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6122911-2d36-490d-88ca-ce6a279dfa16 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e6122911-2d36-490d-88ca-ce6a279dfa16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:40.410197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:40.411092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:40.411966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:40.411966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:40.411966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:40.411966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:40.411966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 441/875] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:40.418763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:40.458003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12acca-1632-4cd7-a366-42d5b55d9c0f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.458318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12acca-1632-4cd7-a366-42d5b55d9c0f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.458657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12acca-1632-4cd7-a366-42d5b55d9c0f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.460926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 442/876] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:40.466071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6308c-a1ce-418f-a0a4-2f1d46c6a769 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.466364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6308c-a1ce-418f-a0a4-2f1d46c6a769 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.466645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6308c-a1ce-418f-a0a4-2f1d46c6a769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.485793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-eeb6308c-a1ce-418f-a0a4-2f1d46c6a769 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:40.487084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-eeb6308c-a1ce-418f-a0a4-2f1d46c6a769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:40.548256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f816652-76b7-444a-8a3c-f4b17f16c1d8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:40.569785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 443/877] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:40 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:40.588094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6308c-a1ce-418f-a0a4-2f1d46c6a769 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:40.588849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:40.589742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.590166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.590599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.591472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:40.591956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:40.593554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:40.607586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 435/878] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:40.612942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:40.639760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:40.691054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:40.719489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6308c-a1ce-418f-a0a4-2f1d46c6a769 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:40.751467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389859c7-22d1-46d8-b70f-7eaa06725797 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:40.766817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6686-a293-46b1-b550-86af7d5e9218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:40.768748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6686-a293-46b1-b550-86af7d5e9218 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.769173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6686-a293-46b1-b550-86af7d5e9218 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.769585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6686-a293-46b1-b550-86af7d5e9218 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.770681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6686-a293-46b1-b550-86af7d5e9218 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:40.773372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6686-a293-46b1-b550-86af7d5e9218 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:40.793534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:40.794513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:40.794798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:40.795068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:40.802530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:40.804631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:40.821750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:40.822744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:40.823662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:40.824824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 436/879] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:52:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:40.828673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:40.880610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 444/880] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:52:40 2022] POST /identity/v3/services => generated 252 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:52:40.922552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:40.951221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa4501-9f2e-4ddc-8b71-329ab9d59573 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:41.007706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031cc6-9ebf-4622-973c-22a7f57f7552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:41.009164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031cc6-9ebf-4622-973c-22a7f57f7552 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.009708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031cc6-9ebf-4622-973c-22a7f57f7552 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.010210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031cc6-9ebf-4622-973c-22a7f57f7552 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.011322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031cc6-9ebf-4622-973c-22a7f57f7552 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:41.011865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031cc6-9ebf-4622-973c-22a7f57f7552 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:41.013779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031cc6-9ebf-4622-973c-22a7f57f7552 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:41.038572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 437/881] 10.222.0.123 () {56 vars in 1154 bytes} [Thu May 26 17:52:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:41.044880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6686-a293-46b1-b550-86af7d5e9218 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:41.159559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6686-a293-46b1-b550-86af7d5e9218 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:41.197201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e6f1-f888-45d0-9874-2a03f45f60fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:41.198216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e6f1-f888-45d0-9874-2a03f45f60fb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.198747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e6f1-f888-45d0-9874-2a03f45f60fb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.199227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e6f1-f888-45d0-9874-2a03f45f60fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.209511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:41.214706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324039-150a-4f9d-951e-8e7d74f8791f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.214994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324039-150a-4f9d-951e-8e7d74f8791f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.215274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324039-150a-4f9d-951e-8e7d74f8791f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.217278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 438/882] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:41.225988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c209b-2108-4932-b14a-b8cf258e9797 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.226548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c209b-2108-4932-b14a-b8cf258e9797 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.228805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c209b-2108-4932-b14a-b8cf258e9797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.245858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ce3c209b-2108-4932-b14a-b8cf258e9797 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:41.247388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ce3c209b-2108-4932-b14a-b8cf258e9797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:41.276743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e6f1-f888-45d0-9874-2a03f45f60fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:41.278205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e6f1-f888-45d0-9874-2a03f45f60fb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:41.339584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 439/883] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:41 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:41.363060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c209b-2108-4932-b14a-b8cf258e9797 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:41.411453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 445/884] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:41 2022] GET /identity/v3/auth/tokens => generated 1254 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:52:41.413395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e6f1-f888-45d0-9874-2a03f45f60fb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:41.445132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:41.455753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:41.499110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c209b-2108-4932-b14a-b8cf258e9797 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:41.521025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e6f1-f888-45d0-9874-2a03f45f60fb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:41.539627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68245ae9-ed93-466c-bb33-49b1ea1ae01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:41.540261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245ae9-ed93-466c-bb33-49b1ea1ae01b None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.540572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245ae9-ed93-466c-bb33-49b1ea1ae01b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.540865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68245ae9-ed93-466c-bb33-49b1ea1ae01b None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.541788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68245ae9-ed93-466c-bb33-49b1ea1ae01b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:41.542953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68245ae9-ed93-466c-bb33-49b1ea1ae01b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:41.559545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d6107-3186-4581-8e93-f5210c7a5409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:41.560356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6107-3186-4581-8e93-f5210c7a5409 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.560642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6107-3186-4581-8e93-f5210c7a5409 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.572420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d6107-3186-4581-8e93-f5210c7a5409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.572420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d6107-3186-4581-8e93-f5210c7a5409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:41.572647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d6107-3186-4581-8e93-f5210c7a5409 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-823d6107-3186-4581-8e93-f5210c7a5409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:41.590412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:41.591343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:41.592215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:41.592215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:41.592215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:41.592215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:41.592215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 446/885] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:41.592865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306224b-ef0f-481d-b93c-039227831f6e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.593069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306224b-ef0f-481d-b93c-039227831f6e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.593343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306224b-ef0f-481d-b93c-039227831f6e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.596190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 447/886] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:41.596780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306224b-ef0f-481d-b93c-039227831f6e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:41.691487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:41.706210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 440/887] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:52:41 2022] POST /identity/v3/services => generated 270 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:52:41.706210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc8cc-b79e-4543-8300-e0f8396566ef None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.706210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc8cc-b79e-4543-8300-e0f8396566ef None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.706210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc8cc-b79e-4543-8300-e0f8396566ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.717985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306224b-ef0f-481d-b93c-039227831f6e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:41.724628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9fafc8cc-b79e-4543-8300-e0f8396566ef None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:41.726082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9fafc8cc-b79e-4543-8300-e0f8396566ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:41.758740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:41.759430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.759718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.759999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.760774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:41.761205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:41.762718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:41.780743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 448/888] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:41.788116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:41.828780 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 441/889] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:41 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:41.851966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafc8cc-b79e-4543-8300-e0f8396566ef None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:41.911188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:41.926952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c11e1-ed1a-42ca-bc2f-cd3ebc00de22 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:41.971178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:41.971898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:41.972183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:41.972496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:41.975907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafc8cc-b79e-4543-8300-e0f8396566ef None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:41.980037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:41.982011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:41.997761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:41.998963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:41.999839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 449/890] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:42.007828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:42.015849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:42.026491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:42.027768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:42.028219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:42.037712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:42.037712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:42.037712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:42.049656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:42.050771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:42.051765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:42.055267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 442/891] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:42.061189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:42.132801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99600-4a93-444b-89f0-2b662bcf765f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:42.179870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:42.181111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:42.181538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:42.182102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:42.183358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:42.184077 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:42.186204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:42.188905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee24b3-22cd-4497-ad00-7d045602e40a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:42.202744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 450/892] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:42.208186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:42.213079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:42.235870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:42.236629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:42.237014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:42.237523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:42.238384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:42.238830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:42.241579 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:42.247955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 443/893] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:42 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:42.253381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:42.289276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:42.329302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f11c0-5e46-4eb6-ab74-b1da7b18fb38 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:42.367284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59d03-cafb-4e4a-989e-a0b991a469b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:42.367892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59d03-cafb-4e4a-989e-a0b991a469b4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:42.368176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59d03-cafb-4e4a-989e-a0b991a469b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:42.368500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59d03-cafb-4e4a-989e-a0b991a469b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:42.369345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59d03-cafb-4e4a-989e-a0b991a469b4 None admin] RBAC: Adding query filter params (role.id=21232936df264a9aa7d922b5d4f5eb05, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=c786580d6b5d4e50afbb2ee7a32acadc) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:42.369654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59d03-cafb-4e4a-989e-a0b991a469b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:42.371067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59d03-cafb-4e4a-989e-a0b991a469b4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:42.384754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 451/894] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:42 2022] GET /identity/v3/role_assignments?user.id=c786580d6b5d4e50afbb2ee7a32acadc&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=21232936df264a9aa7d922b5d4f5eb05 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:42.391477 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ed9b-747e-4872-a15b-7e57373d0b8a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:42.431937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4777e-273b-4031-9e08-4663d3d8942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:42.433078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4777e-273b-4031-9e08-4663d3d8942c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:42.433605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4777e-273b-4031-9e08-4663d3d8942c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:42.434172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4777e-273b-4031-9e08-4663d3d8942c None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:42.435208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4777e-273b-4031-9e08-4663d3d8942c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:42.435721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4777e-273b-4031-9e08-4663d3d8942c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:42.437381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4777e-273b-4031-9e08-4663d3d8942c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:42.444363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 444/895] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:42 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:43.208256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10c6d0-3511-4170-98fb-b6962f326f08 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:43.208807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10c6d0-3511-4170-98fb-b6962f326f08 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:43.208807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10c6d0-3511-4170-98fb-b6962f326f08 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:43.211150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 452/896] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:43.217019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513d067-6499-441d-9c90-a9e467e23b8d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:43.217515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513d067-6499-441d-9c90-a9e467e23b8d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:43.217591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513d067-6499-441d-9c90-a9e467e23b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:43.235388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9513d067-6499-441d-9c90-a9e467e23b8d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:43.236702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9513d067-6499-441d-9c90-a9e467e23b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:43.278794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:43.306705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 445/897] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:43 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:43.329282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10c6d0-3511-4170-98fb-b6962f326f08 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:43.449153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10c6d0-3511-4170-98fb-b6962f326f08 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:43.480938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:43.485222 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:43.486024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:43.486298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:43.486565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:43.487203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:43.488574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:43.500898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:43.503459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:43.504274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 453/898] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:43.508918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513d067-6499-441d-9c90-a9e467e23b8d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:43.614250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513d067-6499-441d-9c90-a9e467e23b8d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:43.651828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:43.652922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:43.653409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:43.653894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:43.654804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:43.655309 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:43.656976 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:43.662809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 446/899] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:43 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:43.668018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:43.779938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548c9a2-f3fb-4faa-80c1-512f53e0ed8c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:43.815089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:43.815759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:43.816038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:43.816326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:43.817024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:43.817326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:43.819290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:43.824785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 454/900] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:43 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:43.830390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:43.876742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:43.946000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8379a2-56fc-42b9-82ab-62d9aa518dbd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:43.990215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217597b-74a4-46d2-9705-be7d5db39b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:43.992119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217597b-74a4-46d2-9705-be7d5db39b99 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:43.992553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217597b-74a4-46d2-9705-be7d5db39b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:43.992845 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217597b-74a4-46d2-9705-be7d5db39b99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:43.993682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217597b-74a4-46d2-9705-be7d5db39b99 None admin] RBAC: Adding query filter params (interface=public, service_id=caa58659a31f4102b4f33ed0e05b0637, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:43.994002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217597b-74a4-46d2-9705-be7d5db39b99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:43.995428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217597b-74a4-46d2-9705-be7d5db39b99 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:44.001786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 447/901] 10.222.0.123 () {56 vars in 1256 bytes} [Thu May 26 17:52:43 2022] GET /identity/v3/endpoints?service_id=caa58659a31f4102b4f33ed0e05b0637&interface=public®ion_id=RegionOne => generated 195 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:44.007595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:44.072606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:44.117142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb2039-08e8-425c-901b-f40bf9284dc9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:44.154645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7ba56-9f86-4b18-9fce-261ee48c2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:44.155328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7ba56-9f86-4b18-9fce-261ee48c2d27 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.155612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7ba56-9f86-4b18-9fce-261ee48c2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.155886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7ba56-9f86-4b18-9fce-261ee48c2d27 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.156599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7ba56-9f86-4b18-9fce-261ee48c2d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:44.157980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7ba56-9f86-4b18-9fce-261ee48c2d27 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:44.165658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 455/902] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:52:44 2022] GET /identity/v3/services => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:52:44.194506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fe11-fefd-45e8-af2e-f5d4d3bf9dc6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.194879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fe11-fefd-45e8-af2e-f5d4d3bf9dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.195085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fe11-fefd-45e8-af2e-f5d4d3bf9dc6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.196757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 448/903] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:44.202443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977e3b-218b-4cb5-a8ba-9cb18f1297bf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.202752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977e3b-218b-4cb5-a8ba-9cb18f1297bf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.203007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977e3b-218b-4cb5-a8ba-9cb18f1297bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.221851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5a977e3b-218b-4cb5-a8ba-9cb18f1297bf None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:44.223058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5a977e3b-218b-4cb5-a8ba-9cb18f1297bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:44.305321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 456/904] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:44 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:44.329115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473fe11-fefd-45e8-af2e-f5d4d3bf9dc6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:44.441696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473fe11-fefd-45e8-af2e-f5d4d3bf9dc6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:44.443253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:44.482078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fa186-d190-484a-b05f-6f65d5c2b708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:44.482916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa186-d190-484a-b05f-6f65d5c2b708 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.483195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa186-d190-484a-b05f-6f65d5c2b708 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.483470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa186-d190-484a-b05f-6f65d5c2b708 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.484146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fa186-d190-484a-b05f-6f65d5c2b708 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:44.485693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fa186-d190-484a-b05f-6f65d5c2b708 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5d5fa186-d190-484a-b05f-6f65d5c2b708 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:44.500145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:44.501179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:44.501981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 449/905] 10.222.0.123 () {56 vars in 1137 bytes} [Thu May 26 17:52:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:44.508698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a977e3b-218b-4cb5-a8ba-9cb18f1297bf None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:44.572739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:44.630047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a977e3b-218b-4cb5-a8ba-9cb18f1297bf None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:44.669288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b31f-2c27-409a-beff-38575d284407 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.669509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:44.669617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b31f-2c27-409a-beff-38575d284407 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.669833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b31f-2c27-409a-beff-38575d284407 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.669997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.670321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.670601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.671310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:44.671616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:44.673015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:44.675027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 450/906] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:44.676581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60e1d6-8966-418f-9c1a-9616ff76fb1a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.676870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60e1d6-8966-418f-9c1a-9616ff76fb1a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.677152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60e1d6-8966-418f-9c1a-9616ff76fb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.679005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 457/907] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:44 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:44.684934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:44.698424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-de60e1d6-8966-418f-9c1a-9616ff76fb1a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:44.699684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-de60e1d6-8966-418f-9c1a-9616ff76fb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:44.778415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 451/908] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:44 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:44.780121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f612b-5fa1-4ad5-bdbf-182e161ade5f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.780448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f612b-5fa1-4ad5-bdbf-182e161ade5f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.780725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f612b-5fa1-4ad5-bdbf-182e161ade5f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.782192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 452/909] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:44.787148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66485ed-2fcf-4300-a354-85d628f2dc06 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.787460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66485ed-2fcf-4300-a354-85d628f2dc06 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.787742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66485ed-2fcf-4300-a354-85d628f2dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.804781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a66485ed-2fcf-4300-a354-85d628f2dc06 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:44.806017 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a66485ed-2fcf-4300-a354-85d628f2dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:44.816155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875614a-0223-4da2-9d00-7a94c53d287c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:44.835186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:44.854081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:44.854740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:44.855015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:44.855283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:44.855971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:44.856273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:44.857657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:44.862622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 458/910] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:44 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:44.863390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:44.892691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 453/911] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:44 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:44.892691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66485ed-2fcf-4300-a354-85d628f2dc06 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:44.929198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:44.976672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab2a6-61b8-4adb-ab4a-40ea59051224 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:45.005874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66485ed-2fcf-4300-a354-85d628f2dc06 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:45.012795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfcc3-414a-486f-8168-886406d9b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:45.013606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfcc3-414a-486f-8168-886406d9b206 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:45.013887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfcc3-414a-486f-8168-886406d9b206 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:45.014160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfcc3-414a-486f-8168-886406d9b206 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:45.025291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bfcc3-414a-486f-8168-886406d9b206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-670bfcc3-414a-486f-8168-886406d9b206 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:45.033454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:45.034601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 459/912] 10.222.0.123 () {56 vars in 1125 bytes} [Thu May 26 17:52:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:45.035474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfcc3-414a-486f-8168-886406d9b206 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:45.050512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:45.051167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:45.051473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:45.051730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:45.052562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] RBAC: Adding query filter params (interface=public, service_id=d03967a0a91f4ab682127e6af588ada5, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:45.052878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:45.054615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:45.059928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 454/913] 10.222.0.123 () {56 vars in 1256 bytes} [Thu May 26 17:52:44 2022] GET /identity/v3/endpoints?service_id=d03967a0a91f4ab682127e6af588ada5&interface=public®ion_id=RegionOne => generated 195 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:45.065090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:45.080387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:45.142918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfcc3-414a-486f-8168-886406d9b206 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:45.168609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:45.177684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c5772-8cce-41a2-b6c9-b2aec4badb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:45.178724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b06c3c-7638-4c54-900c-70a025b8bc5a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:45.179425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5772-8cce-41a2-b6c9-b2aec4badb31 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:45.179425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5772-8cce-41a2-b6c9-b2aec4badb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:45.179425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5772-8cce-41a2-b6c9-b2aec4badb31 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:45.180339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c5772-8cce-41a2-b6c9-b2aec4badb31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:45.181722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c5772-8cce-41a2-b6c9-b2aec4badb31 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:45.213524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:45.214184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:45.214515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:45.214794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:45.215535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:45.215847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:45.217249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:45.229907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 455/914] 10.222.0.123 () {56 vars in 1120 bytes} [Thu May 26 17:52:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:45.229907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:45.262642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 460/915] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:52:45 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:45.264109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c5772-8cce-41a2-b6c9-b2aec4badb31 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:45.367747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69231-79a7-4721-91cc-83405a279bf6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:45.425441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2649a-9db3-4e88-8220-e68c7e3b5a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:45.426805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2649a-9db3-4e88-8220-e68c7e3b5a02 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:45.429658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2649a-9db3-4e88-8220-e68c7e3b5a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:45.430235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2649a-9db3-4e88-8220-e68c7e3b5a02 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:45.431161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2649a-9db3-4e88-8220-e68c7e3b5a02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:45.432957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2649a-9db3-4e88-8220-e68c7e3b5a02 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:45.438049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:45.440696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 456/916] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:52:45 2022] GET /identity/v3/services => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:52:45.446285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c5772-8cce-41a2-b6c9-b2aec4badb31 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:45.493763 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:45.494990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:45.495327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:45.495605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:45.509331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:45.510829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:45.532652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:45.533578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:45.534465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:45.534465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:45.534465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:45.534465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:45.534465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 461/917] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:45.541378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2649a-9db3-4e88-8220-e68c7e3b5a02 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:45.561044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:45.651217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2649a-9db3-4e88-8220-e68c7e3b5a02 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:45.687609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:45.688193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:45.688502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:45.688779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:45.689496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:45.689799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:45.691170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:45.705055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 457/918] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:45.711012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:45.829009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f9481-dc7e-4c8e-abc6-c80056f4ab66 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:45.865099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:45.865996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:45.866312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:45.866592 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:45.875555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:45.877078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:45.892393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:45.893320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:45.894428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 462/919] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:52:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:45.900983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:45.977642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:46.010828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1628cc-caf0-47ff-8030-caa006578f15 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:46.049610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:46.050280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.050605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.050882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.051718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:46.052027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:46.054112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:46.073734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 458/920] 10.222.0.123 () {56 vars in 1154 bytes} [Thu May 26 17:52:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:46.079129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:46.097852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:46.195193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dec1-f2bf-49d0-95cf-fcf86ff32821 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:46.232040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:46.232823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.233104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.233424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.245060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:46.246511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:46.265501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:46.268095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:46.270274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:46.270274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:46.270274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:46.270274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:46.270274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 463/921] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:46.273885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:46.391075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753518-8dbc-4411-b801-115a45934e87 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:46.424660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:46.432984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce450dc9-33eb-476c-9aa5-1d66f783d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:46.433634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce450dc9-33eb-476c-9aa5-1d66f783d003 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.434136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce450dc9-33eb-476c-9aa5-1d66f783d003 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.434411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce450dc9-33eb-476c-9aa5-1d66f783d003 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.435131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce450dc9-33eb-476c-9aa5-1d66f783d003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:46.435439 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce450dc9-33eb-476c-9aa5-1d66f783d003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:46.436840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce450dc9-33eb-476c-9aa5-1d66f783d003 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:46.448736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 459/922] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:46.454416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:46.527011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:46.570004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7453b-fff6-4de6-9bc1-0d5079a5c5f5 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.570544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7453b-fff6-4de6-9bc1-0d5079a5c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.570827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7453b-fff6-4de6-9bc1-0d5079a5c5f5 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.572249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 460/923] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:46.575477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189cf43-b853-4b74-9848-898ee4506b0d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:46.580842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f724-3dc9-40aa-b544-63d412384390 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.581129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f724-3dc9-40aa-b544-63d412384390 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.581405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f724-3dc9-40aa-b544-63d412384390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.605545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ff21f724-3dc9-40aa-b544-63d412384390 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:46.607695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ff21f724-3dc9-40aa-b544-63d412384390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:46.618633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:46.619507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.619801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.620074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.630654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:46.632510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:46.652263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:46.653416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:46.654528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:46.654528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:46.654528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:46.654528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:46.654528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:46.654528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:46.654528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:46.654528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:46.656819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 464/924] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:46.663754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:46.697521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 461/925] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:46 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:46.722535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f724-3dc9-40aa-b544-63d412384390 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:46.799987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330427a2-9963-4615-a29c-5450cf01ffaa None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:46.836104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:46.856638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:46.857818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.858282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.858734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.859233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f724-3dc9-40aa-b544-63d412384390 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:46.859765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:46.860145 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:46.861965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:46.880384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 465/926] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:46.888079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:46.888321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:46.911083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:46.912650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:46.913379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:46.913973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:46.915573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:46.917516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:46.936352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:46.937375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 17:52:46.938195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:46.944671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 462/927] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:46.948212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:47.013385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e37c7-3607-4cee-a27f-0932ca708468 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:47.056087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d887b2-cc31-4da9-a127-529c1d573924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:47.056087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d887b2-cc31-4da9-a127-529c1d573924 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.056087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d887b2-cc31-4da9-a127-529c1d573924 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.056483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d887b2-cc31-4da9-a127-529c1d573924 None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/c786580d6b5d4e50afbb2ee7a32acadc/roles/21232936df264a9aa7d922b5d4f5eb05` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.059954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d887b2-cc31-4da9-a127-529c1d573924 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=c786580d6b5d4e50afbb2ee7a32acadc, role_id=21232936df264a9aa7d922b5d4f5eb05)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:47.062567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d887b2-cc31-4da9-a127-529c1d573924 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:47.093513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f210e-0cbb-4a69-9c5f-b8d24e42db69 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:47.134033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:47.135061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.135351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.135653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.136622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:47.136933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:47.138390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:47.143808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 463/928] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:46 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:47.149806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:47.212615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 466/929] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:52:46 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/c786580d6b5d4e50afbb2ee7a32acadc/roles/21232936df264a9aa7d922b5d4f5eb05 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:52:47.215094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:47.279626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cdc70-2c3d-414f-a8cd-96da19962e0f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:47.327853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed509-95fd-4a37-9494-29ed992c52f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:47.329170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed509-95fd-4a37-9494-29ed992c52f1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.329683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed509-95fd-4a37-9494-29ed992c52f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.330098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed509-95fd-4a37-9494-29ed992c52f1 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.331171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ed509-95fd-4a37-9494-29ed992c52f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:47.331674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ed509-95fd-4a37-9494-29ed992c52f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:47.333265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ed509-95fd-4a37-9494-29ed992c52f1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:47.341769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 464/930] 10.222.0.123 () {56 vars in 1119 bytes} [Thu May 26 17:52:47 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:47.348736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d887b2-cc31-4da9-a127-529c1d573924 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:47.411854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:47.477496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d887b2-cc31-4da9-a127-529c1d573924 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:47.518206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3a90-1ee4-4dec-af0d-4bcae9b3d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:47.519287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3a90-1ee4-4dec-af0d-4bcae9b3d136 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.519625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3a90-1ee4-4dec-af0d-4bcae9b3d136 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.519866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3a90-1ee4-4dec-af0d-4bcae9b3d136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.520750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc3a90-1ee4-4dec-af0d-4bcae9b3d136 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:47.522743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc3a90-1ee4-4dec-af0d-4bcae9b3d136 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:47.625346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 467/931] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:52:47 2022] POST /identity/v3/endpoints => generated 348 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:47.876711 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae5d7-3c46-4611-9cf3-976563c6a16c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.877765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae5d7-3c46-4611-9cf3-976563c6a16c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.878256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae5d7-3c46-4611-9cf3-976563c6a16c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.880173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 465/932] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:47.886901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec3410-cab2-4b7f-9c1a-3697cb48dfbd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.887218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec3410-cab2-4b7f-9c1a-3697cb48dfbd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.887521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec3410-cab2-4b7f-9c1a-3697cb48dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.905202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7643-9054-40b5-a537-2914f39df3d4 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.905549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7643-9054-40b5-a537-2914f39df3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.905767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7643-9054-40b5-a537-2914f39df3d4 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.907894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 466/933] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:47.912672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f7ec3410-cab2-4b7f-9c1a-3697cb48dfbd None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:47.914328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f7ec3410-cab2-4b7f-9c1a-3697cb48dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:47.914653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0949ab-1c98-44e3-baa0-8e2db3cf0387 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:47.914945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0949ab-1c98-44e3-baa0-8e2db3cf0387 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:47.915223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0949ab-1c98-44e3-baa0-8e2db3cf0387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:47.933688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-db0949ab-1c98-44e3-baa0-8e2db3cf0387 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:47.934951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-db0949ab-1c98-44e3-baa0-8e2db3cf0387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:48.005859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 468/934] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:47 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:48.028412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 467/935] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:47 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:48.031318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec3410-cab2-4b7f-9c1a-3697cb48dfbd None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.050639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0949ab-1c98-44e3-baa0-8e2db3cf0387 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.080776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:48.118253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:48.138889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec3410-cab2-4b7f-9c1a-3697cb48dfbd None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.176863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.177200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0949ab-1c98-44e3-baa0-8e2db3cf0387 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.178808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.179304 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.179774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.180817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.182439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:48.196125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:48.197207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:48.198046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:48.206027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 469/936] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:48.207279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.219495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.219495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.219907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.220072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.221134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.223202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:48.239604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:48.240629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 17:52:48.242269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:48.244714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 468/937] 10.222.0.123 () {56 vars in 1137 bytes} [Thu May 26 17:52:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:48.248290 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.335141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:48.348124 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18a66-02f5-4d36-b6a5-7de2fbc6502d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.377239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3cd8-9df5-41b4-99a3-f8bdeef6b8a9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.387131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:48.400947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.400947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.400947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.400947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.402040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:48.402040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.402040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.409041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 470/938] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:48 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:48.414586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.422194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.422849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.423126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.423394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.424089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:48.424419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.426654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.435176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 469/939] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:48 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:48.444524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.551726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1caa6-18fa-4c0c-8e84-15204156e175 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.555507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c55b5d-314d-4063-985a-3b60e390cc6e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.591798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.592691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.592970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.593245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.593570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.594003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:48.594228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.594330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.594512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.594790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.595496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:48.595749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.595849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.597381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.601712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 471/940] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:48 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:48.603873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 470/941] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:48 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:48.609310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.609460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.632699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:48.645175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:48.712920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad55360-0537-4739-87c9-676b873ffd4b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.715434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2411df-5ac0-4072-a616-06b382167b88 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.749761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.750762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.751119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.751473 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.752372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] RBAC: Adding query filter params (interface=public, service_id=6fd23aa8475a4cccab3056b8b51b6d74, region_id=RegionOne) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:48.752549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14befa5e-a824-4e71-90f3-a4f1e41cbbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.752823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.753328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14befa5e-a824-4e71-90f3-a4f1e41cbbc2 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.753672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14befa5e-a824-4e71-90f3-a4f1e41cbbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.754007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14befa5e-a824-4e71-90f3-a4f1e41cbbc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.754467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.754870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14befa5e-a824-4e71-90f3-a4f1e41cbbc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.756287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14befa5e-a824-4e71-90f3-a4f1e41cbbc2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.760635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 472/942] 10.222.0.123 () {56 vars in 1256 bytes} [Thu May 26 17:52:48 2022] GET /identity/v3/endpoints?service_id=6fd23aa8475a4cccab3056b8b51b6d74&interface=public®ion_id=RegionOne => generated 195 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:48.766981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:48.855237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:48.873530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01ceca-1942-416f-9adf-d177914e336a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:48.889777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 471/943] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:52:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:48.924732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3b91a-2914-4d29-8497-497ecfd1c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:48.925854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3b91a-2914-4d29-8497-497ecfd1c5bf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:48.926340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3b91a-2914-4d29-8497-497ecfd1c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:48.926812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3b91a-2914-4d29-8497-497ecfd1c5bf None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:48.927708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3b91a-2914-4d29-8497-497ecfd1c5bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:48.929528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3b91a-2914-4d29-8497-497ecfd1c5bf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:48.937944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 473/944] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:52:48 2022] GET /identity/v3/services => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:52:49.643309 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e542c-593a-4978-b707-5147624ead35 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:49.643949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e542c-593a-4978-b707-5147624ead35 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:49.644478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e542c-593a-4978-b707-5147624ead35 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:49.646332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 472/945] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:49.652257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131e5b-f11c-4361-9ab4-18a2d0a316d8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:49.653171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131e5b-f11c-4361-9ab4-18a2d0a316d8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:49.653655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131e5b-f11c-4361-9ab4-18a2d0a316d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:49.671313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1e131e5b-f11c-4361-9ab4-18a2d0a316d8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:49.672848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1e131e5b-f11c-4361-9ab4-18a2d0a316d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:49.752228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 474/946] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:49 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:49.776649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e542c-593a-4978-b707-5147624ead35 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:49.872580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:49.885719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e542c-593a-4978-b707-5147624ead35 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:49.921922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0227d4-0ade-4975-a72b-98bbbe1d903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:49.922672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0227d4-0ade-4975-a72b-98bbbe1d903a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:49.922905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0227d4-0ade-4975-a72b-98bbbe1d903a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:49.923176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0227d4-0ade-4975-a72b-98bbbe1d903a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:49.938379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0227d4-0ade-4975-a72b-98bbbe1d903a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3a0227d4-0ade-4975-a72b-98bbbe1d903a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:52:49.947642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:49.948595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:49.949969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 473/947] 10.222.0.123 () {56 vars in 1125 bytes} [Thu May 26 17:52:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:49.954887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131e5b-f11c-4361-9ab4-18a2d0a316d8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.030981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:50.066081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131e5b-f11c-4361-9ab4-18a2d0a316d8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.079591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002d5b-b4d3-4808-b07b-966c7ea8f153 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.080234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002d5b-b4d3-4808-b07b-966c7ea8f153 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.080737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002d5b-b4d3-4808-b07b-966c7ea8f153 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.082701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 474/948] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:50.088666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869957a-9013-4472-bcd8-0a890a26fde6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.089478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869957a-9013-4472-bcd8-0a890a26fde6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.090037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869957a-9013-4472-bcd8-0a890a26fde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.107114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.107932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.108221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.108533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.109305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:50.109620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.111046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.112183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1869957a-9013-4472-bcd8-0a890a26fde6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:50.113955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1869957a-9013-4472-bcd8-0a890a26fde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:50.121828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 475/949] 10.222.0.123 () {56 vars in 1120 bytes} [Thu May 26 17:52:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:50.127622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.204642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 475/950] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:50 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:50.225860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869957a-9013-4472-bcd8-0a890a26fde6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.236795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b18b9-754f-4653-9352-680881f52407 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.273706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.274420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.274708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.274986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.277015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:50.286804 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.290912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:50.310372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:50.311282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:50.312150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:50.312150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:50.312150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:50.312150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:50.312150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 476/951] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:50.316954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.328242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:50.349809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869957a-9013-4472-bcd8-0a890a26fde6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.389820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.390967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.391451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.391923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.392864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.394715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.396315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING keystone.server.flask.common [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 17:52:50.435342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20a9ae-cce3-4b58-aae9-ee0e5825723e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.458049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.sql.core [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 17:52:50.458049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 17:52:50.458049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [parameters: {'id': '39675af30d294248adef38913d5391c6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 17:52:50.458049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80358) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 17:52:50.472760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.473511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.473886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.474240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.475038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:50.475499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.477054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39675af30d294248adef38913d5391c6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39675af30d294248adef38913d5391c6. May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application conn.query(q) May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:52:50.481475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result.read() May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 17:52:50.482268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application next(self.gen) May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application yield resource May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application next(self.gen) May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.session.rollback() May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.force_reraise() May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise self.value May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application session.commit() May 26 17:52:50.483358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._prepare_impl() May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.session.flush() May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._flush(objects) May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application compat.raise_( May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application flush_context.execute() May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 17:52:50.484226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rec.execute(self) May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 17:52:50.485938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application conn.query(q) May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result.read() May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:52:50.486722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [parameters: {'id': '39675af30d294248adef38913d5391c6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:50.489812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:50.492444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39675af30d294248adef38913d5391c6. May 26 17:52:50.494252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:50.501734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 477/953] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:50.501948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 476/953] 10.222.0.123 () {60 vars in 1145 bytes} [Thu May 26 17:52:50 2022] POST /identity/v3/projects => generated 262 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:50.502955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.503539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.555804 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:50.623945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa73e-cacd-4ec8-a628-e2eaf95c9a88 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.638055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fcbd4-3af7-4fd9-9e42-e0f9b163064d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.671932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.673522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.673631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.674110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.674560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.674674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.674921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.675269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.679030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:50.684563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.685620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.690351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.690459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:50.702847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:50.703737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:50.704709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:50.704709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:50.704709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:50.704709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:50.704709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:50.704709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:50.704709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:50.704709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:50.705137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:50.705982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 17:52:50.706930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:50.714446 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 477/954] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:52:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:50.714446 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.715057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 478/955] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:50.717215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.829495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f635fc9-72c7-4b68-b48b-c431c2debcce None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.862950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f3329-eabf-49bc-a78a-7be5f2d27667 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:50.867227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.867227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.867470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.867836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.868886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:50.869268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.870830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.873126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:50.899435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 478/956] 10.222.0.123 () {56 vars in 1154 bytes} [Thu May 26 17:52:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:50.900930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:50.907566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3b1dd-ad0a-4136-83f8-0c2cfd005bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:50.908512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b1dd-ad0a-4136-83f8-0c2cfd005bbe None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:50.908991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b1dd-ad0a-4136-83f8-0c2cfd005bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:50.909442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b1dd-ad0a-4136-83f8-0c2cfd005bbe None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:50.910794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3b1dd-ad0a-4136-83f8-0c2cfd005bbe None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:50.911299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3b1dd-ad0a-4136-83f8-0c2cfd005bbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:50.913940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3b1dd-ad0a-4136-83f8-0c2cfd005bbe None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:50.940869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 479/957] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:50 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:50.974629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:51.031785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d33826-3fa9-480c-b456-1b1e697a721b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:51.076082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9b000-f893-4377-9b81-2ec0d43ecd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:51.076819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b000-f893-4377-9b81-2ec0d43ecd55 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.077107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b000-f893-4377-9b81-2ec0d43ecd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.077384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b000-f893-4377-9b81-2ec0d43ecd55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.161011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9b000-f893-4377-9b81-2ec0d43ecd55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:51.163473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9b000-f893-4377-9b81-2ec0d43ecd55 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:51.223451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:51.238521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e355346-e4e6-490f-abef-bed27d65d21f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.238521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e355346-e4e6-490f-abef-bed27d65d21f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.238521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e355346-e4e6-490f-abef-bed27d65d21f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.240197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 480/958] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:51.246209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e640bb-0126-4ca3-bb08-157f50df61e2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.246576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e640bb-0126-4ca3-bb08-157f50df61e2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.246798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e640bb-0126-4ca3-bb08-157f50df61e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.267462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-08e640bb-0126-4ca3-bb08-157f50df61e2 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:51.268678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-08e640bb-0126-4ca3-bb08-157f50df61e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:51.284668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 479/959] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:52:50 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:52:51.290188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2679a0f-aa1a-4e3c-8b88-9723861d6fcf None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.290475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2679a0f-aa1a-4e3c-8b88-9723861d6fcf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.290748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2679a0f-aa1a-4e3c-8b88-9723861d6fcf None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.292257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 480/960] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:51.293557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2679a0f-aa1a-4e3c-8b88-9723861d6fcf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:51.357996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 481/961] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:51 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:51.359550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cd517-6f41-482c-8df0-b2a38f98f046 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.359843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cd517-6f41-482c-8df0-b2a38f98f046 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.360119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cd517-6f41-482c-8df0-b2a38f98f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.377070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d92cd517-6f41-482c-8df0-b2a38f98f046 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:51.378796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d92cd517-6f41-482c-8df0-b2a38f98f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:51.414472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2679a0f-aa1a-4e3c-8b88-9723861d6fcf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:51.453478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:51.454265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.454552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.454827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.456908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 482/962] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:51 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:51.457895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cd517-6f41-482c-8df0-b2a38f98f046 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:51.474809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:51.476969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:51.489869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:52:51.496687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:51.497600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:51.498470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:52:51.498470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:52:51.498470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:52:51.498470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:51.498470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 481/963] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:51.499342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:51.507948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:51.572686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cd517-6f41-482c-8df0-b2a38f98f046 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:51.606379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425285-4d46-455e-a32e-c71f22bf8b29 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:51.610696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:51.611513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.611793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.612065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.612735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:51.614095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:51.625951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:51.626979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:52:51.627942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:51.632584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 483/964] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:51.633466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:51.646893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:51.648363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.648714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.648931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.649532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:51.650904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:51.663159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:51.664144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:51.665082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 482/965] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:51.665982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:51.738319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:51.753378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12423f6-4725-493e-8917-7494a1b3b2fc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:51.754197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:51.785390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:51.786132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.786392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.786727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.787472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:51.793737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:51.793870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829592ab-e2f3-456f-87ef-6f5266585311 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:51.793956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:51.803000 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 484/966] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:52:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:51.803924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:51.829900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:51.830560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.830849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.831120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.831825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:51.832134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:51.833561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:51.839676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 483/967] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:51 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:51.840334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:51.924113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ef808-212d-4b9d-8f52-4fb78bb46506 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:51.946651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031ec0d-ebb3-49d5-b209-5795caa73d51 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:51.961925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:51.962588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.962980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.963254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.963951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:51.964254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:51.965636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:51.970465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 485/968] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:51 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:51.971038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:51.985628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:51.986416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:51.986546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:51.986708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:51.986974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:51.989037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:51.995485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:51.996979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:52:52.012231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:52.013189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 484/969] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:52.019376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:52.090195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b7436-8ce3-44c5-8cb3-38e29935829b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:52.127448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:52.128111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:52.128460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:52.128710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:52.129493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:52.129715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:52.131078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:52.135356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340b37b-06b6-4f50-a04e-95deda1ba9e3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:52.135891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 486/970] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:51 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:52.136717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:52.186656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:52.187871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:52.188219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:52.188596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:52.189458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:52.189834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:52.191497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:52.199324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 485/971] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:52 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:52.205119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:52.247681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:52.277635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e9fb0-d6b8-4d6b-8274-1380c16bb82c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:52.302461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:52.329048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:52.329937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:52.330336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:52.330989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:52.331591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:52.332008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:52.334072 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:52.355227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 487/972] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:52.356358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:52.368886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbbfe3-baa7-43eb-a0d0-7eeb37aa9fa6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:52.414608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25c280-aacf-4cc8-82b0-c403898d3564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:52.415684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c280-aacf-4cc8-82b0-c403898d3564 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:52.416193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c280-aacf-4cc8-82b0-c403898d3564 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:52.416723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c280-aacf-4cc8-82b0-c403898d3564 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:52.418204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25c280-aacf-4cc8-82b0-c403898d3564 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:52.420473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25c280-aacf-4cc8-82b0-c403898d3564 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:52.467059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8763c-3d1c-476d-a68d-12c56317f77c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:52.502165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ead9c1-d4d5-4052-b481-2bfb1c9e4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:52.502816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ead9c1-d4d5-4052-b481-2bfb1c9e4509 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:52.503094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ead9c1-d4d5-4052-b481-2bfb1c9e4509 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:52.503365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ead9c1-d4d5-4052-b481-2bfb1c9e4509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:52.504178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ead9c1-d4d5-4052-b481-2bfb1c9e4509 None admin] RBAC: Adding query filter params (role.id=21232936df264a9aa7d922b5d4f5eb05, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=c786580d6b5d4e50afbb2ee7a32acadc) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:52.504511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ead9c1-d4d5-4052-b481-2bfb1c9e4509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:52.505915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ead9c1-d4d5-4052-b481-2bfb1c9e4509 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:52.516404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 488/973] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:52:52 2022] GET /identity/v3/role_assignments?user.id=c786580d6b5d4e50afbb2ee7a32acadc&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=21232936df264a9aa7d922b5d4f5eb05 => generated 610 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:52.526186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 486/974] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:52:52 2022] POST /identity/v3/endpoints => generated 351 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:53.358552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a38b-a2a1-4340-9bd4-2f95e77d7ece None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:53.359139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a38b-a2a1-4340-9bd4-2f95e77d7ece None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:53.359139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a38b-a2a1-4340-9bd4-2f95e77d7ece None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:53.360547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 489/975] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:53.367819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbc4f4-d72a-40a1-b450-6681288ed7c5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:53.368877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbc4f4-d72a-40a1-b450-6681288ed7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:53.369381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbc4f4-d72a-40a1-b450-6681288ed7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:53.387538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1afbc4f4-d72a-40a1-b450-6681288ed7c5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:53.389445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1afbc4f4-d72a-40a1-b450-6681288ed7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:53.465421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 487/976] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:53 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:53.490278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661a38b-a2a1-4340-9bd4-2f95e77d7ece None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:53.494295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:53.603106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661a38b-a2a1-4340-9bd4-2f95e77d7ece None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:53.640248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:53.641262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:53.641762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:53.642277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:53.643188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:53.644880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:53.646408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING keystone.server.flask.common [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 17:52:53.703369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.sql.core [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 17:52:53.703369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 17:52:53.703369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [parameters: {'user_id': '4f516a4a425c460c9552a376ba1fc2cc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 17:52:53.703369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80357) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application conn.query(q) May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result.read() May 26 17:52:53.711853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:52:53.712805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application next(self.gen) May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application yield resource May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application next(self.gen) May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.session.rollback() May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.force_reraise() May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise self.value May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application session.commit() May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 17:52:53.713829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._prepare_impl() May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.session.flush() May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._flush(objects) May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application compat.raise_( May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application flush_context.execute() May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rec.execute(self) May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 17:52:53.714732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 17:52:53.715649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result = self._query(query) May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application conn.query(q) May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result.read() May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 17:52:53.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [parameters: {'user_id': '4f516a4a425c460c9552a376ba1fc2cc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:53.718778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 17:52:53.720833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 17:52:53.723149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 17:52:53.723149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 17:52:53.723149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 17:52:53.723149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 17:52:53.723149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 17:52:53.723149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:53.726747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 490/977] 10.222.0.123 () {60 vars in 1136 bytes} [Thu May 26 17:52:53 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:53.732561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbc4f4-d72a-40a1-b450-6681288ed7c5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:53.776481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:53.836742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbc4f4-d72a-40a1-b450-6681288ed7c5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:53.877943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5dd81-e168-47a7-b95c-4a9991903f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:53.877943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5dd81-e168-47a7-b95c-4a9991903f40 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:53.877943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5dd81-e168-47a7-b95c-4a9991903f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:53.877943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5dd81-e168-47a7-b95c-4a9991903f40 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:53.883327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5dd81-e168-47a7-b95c-4a9991903f40 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:53.885449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5dd81-e168-47a7-b95c-4a9991903f40 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-afd5dd81-e168-47a7-b95c-4a9991903f40 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:52:53.901600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:53.902636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 17:52:53.903657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:53.906623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 488/978] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:52:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:53.914225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:53.982477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:54.026672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812c765-865b-42ba-a3ba-a380ed16b1a3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:54.067445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755eec1-9feb-44c9-aee9-1171ee46706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:54.068193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755eec1-9feb-44c9-aee9-1171ee46706f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.068504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755eec1-9feb-44c9-aee9-1171ee46706f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.068787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755eec1-9feb-44c9-aee9-1171ee46706f None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.070780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755eec1-9feb-44c9-aee9-1171ee46706f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:54.071091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755eec1-9feb-44c9-aee9-1171ee46706f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:54.072750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755eec1-9feb-44c9-aee9-1171ee46706f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:54.113030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 491/979] 10.222.0.123 () {56 vars in 1106 bytes} [Thu May 26 17:52:53 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:54.545534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac20e-ada1-4c10-a4f8-f095ac1b532c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.546044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac20e-ada1-4c10-a4f8-f095ac1b532c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.546146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac20e-ada1-4c10-a4f8-f095ac1b532c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.547614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 489/980] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:54.552793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf7f2-ee50-4c88-91b5-f5c735e32d51 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.553185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf7f2-ee50-4c88-91b5-f5c735e32d51 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.553348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf7f2-ee50-4c88-91b5-f5c735e32d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.570795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dcabf7f2-ee50-4c88-91b5-f5c735e32d51 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:54.572318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dcabf7f2-ee50-4c88-91b5-f5c735e32d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:54.641307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 492/981] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:54 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:54.664614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac20e-ada1-4c10-a4f8-f095ac1b532c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:54.773571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:54.778087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac20e-ada1-4c10-a4f8-f095ac1b532c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:54.813388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6ff38-df8c-4f79-a817-e4ad9b6c06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:54.813963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ff38-df8c-4f79-a817-e4ad9b6c06ee None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.814248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ff38-df8c-4f79-a817-e4ad9b6c06ee None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.814528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ff38-df8c-4f79-a817-e4ad9b6c06ee None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.815246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6ff38-df8c-4f79-a817-e4ad9b6c06ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:54.816653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6ff38-df8c-4f79-a817-e4ad9b6c06ee None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:54.865123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489c2b-d275-4816-83be-621ece010bd4 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.865408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489c2b-d275-4816-83be-621ece010bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.865678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489c2b-d275-4816-83be-621ece010bd4 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.867392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 493/982] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:54.872108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e0cc-89fb-43b3-9109-4598b7d7f462 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.872431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e0cc-89fb-43b3-9109-4598b7d7f462 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.872704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e0cc-89fb-43b3-9109-4598b7d7f462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.889592 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a027e0cc-89fb-43b3-9109-4598b7d7f462 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:54.890757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a027e0cc-89fb-43b3-9109-4598b7d7f462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:54.910036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 490/983] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:52:54 2022] POST /identity/v3/services => generated 243 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:52:54.911450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53eb5-70cb-400e-b35d-c68582c31d2b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.911740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53eb5-70cb-400e-b35d-c68582c31d2b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.912034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53eb5-70cb-400e-b35d-c68582c31d2b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.914084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 491/984] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:54.919553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43576e57-0bd2-4ff6-b5e0-1960d6c4e439 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:54.923337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43576e57-0bd2-4ff6-b5e0-1960d6c4e439 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:54.923337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43576e57-0bd2-4ff6-b5e0-1960d6c4e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:54.939991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-43576e57-0bd2-4ff6-b5e0-1960d6c4e439 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:54.941384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-43576e57-0bd2-4ff6-b5e0-1960d6c4e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:54.942248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:54.971368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 494/985] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:54 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:54.995572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027e0cc-89fb-43b3-9109-4598b7d7f462 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:55.026623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 492/986] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:54 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:55.049302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43576e57-0bd2-4ff6-b5e0-1960d6c4e439 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:55.113202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027e0cc-89fb-43b3-9109-4598b7d7f462 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.154627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.155437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.155719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.155994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.156676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.158047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.159858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43576e57-0bd2-4ff6-b5e0-1960d6c4e439 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.161457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:55.170833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:55.171881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:55.172781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 495/987] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:55.178007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:55.198943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.199748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.200025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.200295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] PATH_INFO: `/v3/services/image` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.200974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.202344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:55.215084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:55.221902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:55.222710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 493/988] 10.222.0.123 () {56 vars in 1110 bytes} [Thu May 26 17:52:55 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:55.223589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:55.229819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:55.298719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159962d2-d581-4a08-a9e2-7623c9992bda None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.332133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50040-9968-45ed-8950-45c6930ca025 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.336634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.337329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.337617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.337893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.338606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:55.338921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.340325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.345432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 496/989] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:55 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:55.351670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:55.376033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.376647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.376928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.377206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.377915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] RBAC: Adding query filter params (name=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:55.378225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.379630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.390567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 494/990] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:55 2022] GET /identity/v3/services?name=image => generated 123 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:55.391536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:55.411656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:55.466393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057eba-06b7-4380-9b6e-8a5f7de9df5c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.473246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:55.499956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2404056-6f68-4e36-8a7e-7a086b3572be None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.501501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.502167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.502442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.503445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.503445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:55.503692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.505076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.516836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 497/991] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:55 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:55.517836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:55.543398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.544170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.544498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.544909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.545470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] RBAC: Adding query filter params (type=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:55.545777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.547149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.552575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 495/992] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:52:55 2022] GET /identity/v3/services?type=image => generated 123 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:55.645210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1900035-d6d0-484a-a7a3-48dc4fbbc8f9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.683112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cafc87-95d6-4333-814c-bd4fdc5a37f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.683799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafc87-95d6-4333-814c-bd4fdc5a37f2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.684084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafc87-95d6-4333-814c-bd4fdc5a37f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.684387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafc87-95d6-4333-814c-bd4fdc5a37f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.685199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cafc87-95d6-4333-814c-bd4fdc5a37f2 None admin] RBAC: Adding query filter params (interface=admin, service_id=6fd23aa8475a4cccab3056b8b51b6d74, region_id=RegionOne) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:55.685515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cafc87-95d6-4333-814c-bd4fdc5a37f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.686913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cafc87-95d6-4333-814c-bd4fdc5a37f2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.698456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 498/993] 10.222.0.123 () {56 vars in 1254 bytes} [Thu May 26 17:52:55 2022] GET /identity/v3/endpoints?service_id=6fd23aa8475a4cccab3056b8b51b6d74&interface=admin®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:55.700438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:55.790586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:55.809131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10440e31-ee34-4fe6-9cb5-91eaebcdd228 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:55.842615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe95ec-bf83-4093-9e7a-303612443b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:55.843277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe95ec-bf83-4093-9e7a-303612443b11 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:55.843560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe95ec-bf83-4093-9e7a-303612443b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:55.843834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe95ec-bf83-4093-9e7a-303612443b11 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:55.844540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe95ec-bf83-4093-9e7a-303612443b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:55.845922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe95ec-bf83-4093-9e7a-303612443b11 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:55.852786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 496/994] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:52:55 2022] GET /identity/v3/services => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:52:57.174563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7eec-b7f7-4f8c-b871-990ca98e8b82 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:57.175125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7eec-b7f7-4f8c-b871-990ca98e8b82 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:57.175125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7eec-b7f7-4f8c-b871-990ca98e8b82 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:57.176539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 499/995] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:57.182827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fad8-c5b4-4af8-ac7c-46baf952c39a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:57.183255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fad8-c5b4-4af8-ac7c-46baf952c39a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:57.183425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fad8-c5b4-4af8-ac7c-46baf952c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:57.200720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7e17fad8-c5b4-4af8-ac7c-46baf952c39a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:57.201899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7e17fad8-c5b4-4af8-ac7c-46baf952c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:57.271597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 497/996] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:57 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:52:57.297342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7eec-b7f7-4f8c-b871-990ca98e8b82 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:57.333478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:57.404360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7eec-b7f7-4f8c-b871-990ca98e8b82 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:57.439013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:57.439729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:57.440016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:57.440286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:57.440958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:57.442325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:57.454706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:57.455691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:52:57.457103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:52:57.458187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 500/997] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:52:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:52:57.462209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17fad8-c5b4-4af8-ac7c-46baf952c39a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:57.542712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:57.565346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17fad8-c5b4-4af8-ac7c-46baf952c39a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:57.598191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:57.598859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:57.599138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:57.599410 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:57.600110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:57.600443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:57.602544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:57.611927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 498/998] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:57 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:57.613149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:57.717541 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:57.721936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86fbbc-22fb-4a98-b2df-f8bbc76db915 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:57.756543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ebf4a-5ef3-46fd-af39-6e396c4071d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:57.757299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ebf4a-5ef3-46fd-af39-6e396c4071d1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:57.757581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ebf4a-5ef3-46fd-af39-6e396c4071d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:57.757856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ebf4a-5ef3-46fd-af39-6e396c4071d1 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:57.758559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ebf4a-5ef3-46fd-af39-6e396c4071d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:57.758867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ebf4a-5ef3-46fd-af39-6e396c4071d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:57.760511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ebf4a-5ef3-46fd-af39-6e396c4071d1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:57.765643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 501/999] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:52:57 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:57.771276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:57.838412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af5cd2-3c2a-4815-9e00-926e5db7945b None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:57.838755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af5cd2-3c2a-4815-9e00-926e5db7945b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:57.838993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af5cd2-3c2a-4815-9e00-926e5db7945b None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:57.844252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 502/1000] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:52:57.845490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2563a-ac94-42c9-ad03-88868540bbe5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:57.845783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2563a-ac94-42c9-ad03-88868540bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:57.846183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2563a-ac94-42c9-ad03-88868540bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:57.864525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1cc2563a-ac94-42c9-ad03-88868540bbe5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:57.865834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1cc2563a-ac94-42c9-ad03-88868540bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:57.876483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73c1c2-063c-484c-a3b8-27d527ecb05d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:57.916833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:57.917684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:57.918065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:57.918347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:57.919147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] RBAC: Adding query filter params (interface=public, service_id=6ddd6ebce02d4a95b676a65b26940208, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:57.919460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:57.921066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:57.926818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 499/1001] 10.222.0.123 () {56 vars in 1256 bytes} [Thu May 26 17:52:57 2022] GET /identity/v3/endpoints?service_id=6ddd6ebce02d4a95b676a65b26940208&interface=public®ion_id=RegionOne => generated 195 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:57.932874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:57.937312 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:57.948952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 503/1002] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:57 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:57.971584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2563a-ac94-42c9-ad03-88868540bbe5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:58.039700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0b754-d780-412b-8309-7c94a349255f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:58.074432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:58.078906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ae630-352e-4c39-81c4-f633d970399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:58.079699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae630-352e-4c39-81c4-f633d970399c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.079990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae630-352e-4c39-81c4-f633d970399c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.080288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae630-352e-4c39-81c4-f633d970399c None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.081100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ae630-352e-4c39-81c4-f633d970399c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:58.082588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ae630-352e-4c39-81c4-f633d970399c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:58.083481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2563a-ac94-42c9-ad03-88868540bbe5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:58.090910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 500/1003] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:52:57 2022] GET /identity/v3/services => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:52:58.097912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f184f-7875-45bd-b7ad-bb21744d4965 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.097912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f184f-7875-45bd-b7ad-bb21744d4965 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.097912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f184f-7875-45bd-b7ad-bb21744d4965 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.097912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 501/1004] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:52:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:52:58.101303 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669870-fdf4-481e-a19c-b47f9d930295 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.101597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669870-fdf4-481e-a19c-b47f9d930295 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.101884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7669870-fdf4-481e-a19c-b47f9d930295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.119716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f7669870-fdf4-481e-a19c-b47f9d930295 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:52:58.121040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f7669870-fdf4-481e-a19c-b47f9d930295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:52:58.124890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3922d-32e2-499b-b068-fb9821b5e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:58.125579 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3922d-32e2-499b-b068-fb9821b5e638 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.135993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3922d-32e2-499b-b068-fb9821b5e638 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.135993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3922d-32e2-499b-b068-fb9821b5e638 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.135993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3922d-32e2-499b-b068-fb9821b5e638 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:58.135993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3922d-32e2-499b-b068-fb9821b5e638 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:58.189521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:58.195717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 502/1005] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:52:58 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:52:58.220606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7669870-fdf4-481e-a19c-b47f9d930295 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:58.324295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7669870-fdf4-481e-a19c-b47f9d930295 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:58.359032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:58.359821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.360095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.360542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.361294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:58.362681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:52:58.374954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:52:58.378970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:52:58.380016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 503/1006] 10.222.0.123 () {56 vars in 1131 bytes} [Thu May 26 17:52:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:52:58.382543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:58.383476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 504/1007] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:52:57 2022] POST /identity/v3/services => generated 243 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:52:58.495716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde1884-12aa-423f-ad8d-0cb56a461b33 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:58.537771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:58.539214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.539496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.539791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.540494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:58.540799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:58.542287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:58.552596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 504/1008] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:58 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:52:58.553544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3922d-32e2-499b-b068-fb9821b5e638 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:58.590436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:58.664249 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3922d-32e2-499b-b068-fb9821b5e638 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:58.699820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c9cb0-c05d-49dd-8afe-049115e0f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:58.700588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9cb0-c05d-49dd-8afe-049115e0f6ee None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.700811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9cb0-c05d-49dd-8afe-049115e0f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.701086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9cb0-c05d-49dd-8afe-049115e0f6ee None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.701791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9cb0-c05d-49dd-8afe-049115e0f6ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:52:58.702098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9cb0-c05d-49dd-8afe-049115e0f6ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:58.703479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9cb0-c05d-49dd-8afe-049115e0f6ee None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:58.733063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 505/1009] 10.222.0.123 () {56 vars in 1127 bytes} [Thu May 26 17:52:58 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:52:58.738666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:52:58.843996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960adf77-9069-4704-a343-eb93b239b933 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:52:58.866825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:58.878693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf7bbd-e042-4bdc-a7a7-38431d79002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:52:58.887544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf7bbd-e042-4bdc-a7a7-38431d79002e None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:52:58.887544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf7bbd-e042-4bdc-a7a7-38431d79002e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:52:58.887544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf7bbd-e042-4bdc-a7a7-38431d79002e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:52:58.887544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf7bbd-e042-4bdc-a7a7-38431d79002e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:52:58.887544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf7bbd-e042-4bdc-a7a7-38431d79002e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:52:59.132482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 505/1010] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:52:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:53:00.338056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1063a8-87b8-45ae-9899-90d1b8a6a134 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:00.338600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1063a8-87b8-45ae-9899-90d1b8a6a134 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:00.338600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1063a8-87b8-45ae-9899-90d1b8a6a134 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:00.339952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 506/1011] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:53:00.345547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce114b-337e-45ff-92c1-923ad5a45690 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:00.345945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce114b-337e-45ff-92c1-923ad5a45690 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:00.346105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce114b-337e-45ff-92c1-923ad5a45690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:00.363384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f2ce114b-337e-45ff-92c1-923ad5a45690 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:00.364620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f2ce114b-337e-45ff-92c1-923ad5a45690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:00.438318 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 506/1012] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:00 2022] POST /identity/v3/auth/tokens => generated 1806 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:00.461467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1063a8-87b8-45ae-9899-90d1b8a6a134 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:00.480713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:00.577309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1063a8-87b8-45ae-9899-90d1b8a6a134 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:00.611316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00546be1-1a06-4f7c-9625-10db3a3c6e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:00.612108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546be1-1a06-4f7c-9625-10db3a3c6e85 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:00.612424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546be1-1a06-4f7c-9625-10db3a3c6e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:00.612703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546be1-1a06-4f7c-9625-10db3a3c6e85 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:00.613347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00546be1-1a06-4f7c-9625-10db3a3c6e85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:00.614730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00546be1-1a06-4f7c-9625-10db3a3c6e85 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-00546be1-1a06-4f7c-9625-10db3a3c6e85 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:00.627211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:00.628200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 17:53:00.629095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:00.632647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 507/1013] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:53:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:00.634884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce114b-337e-45ff-92c1-923ad5a45690 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:00.683233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5167078-3ea9-43d1-9626-f96cde99d2a0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:00.683512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5167078-3ea9-43d1-9626-f96cde99d2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:00.683958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5167078-3ea9-43d1-9626-f96cde99d2a0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:00.685484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 508/1014] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:53:00.690708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab47a-3aec-4257-92f1-2df736a45d0d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:00.691499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab47a-3aec-4257-92f1-2df736a45d0d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:00.691991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab47a-3aec-4257-92f1-2df736a45d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:00.709605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2f9ab47a-3aec-4257-92f1-2df736a45d0d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:00.711195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2f9ab47a-3aec-4257-92f1-2df736a45d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:00.738311 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce114b-337e-45ff-92c1-923ad5a45690 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:00.749136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:00.774251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:00.774905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:00.775182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:00.775453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:00.776153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:00.776483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:00.777904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:00.784349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 509/1015] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:00 2022] POST /identity/v3/auth/tokens => generated 1806 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:53:00.784505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 507/1016] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:53:00 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:00.788850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ab47a-3aec-4257-92f1-2df736a45d0d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:00.800593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:00.808928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:00.895615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ab47a-3aec-4257-92f1-2df736a45d0d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:00.925212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bc77f-1e1d-4eb9-bfa6-ac5e507759f6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:00.940228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:00.940913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:00.941188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:00.941468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:00.942174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:00.942483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:00.943864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:00.949743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 510/1017] 10.222.0.123 () {56 vars in 1117 bytes} [Thu May 26 17:53:00 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:00.955026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:00.966357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:00.967512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:00.967794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:00.968137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] PATH_INFO: `/v3/services/image` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:00.969090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:00.970531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:00.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:00.984157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:00.985034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 508/1018] 10.222.0.123 () {56 vars in 1110 bytes} [Thu May 26 17:53:00 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:53:00.990764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:01.030523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:01.035534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:01.061506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed4dc2-49db-479f-93cd-08aea817a0e1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:01.098951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73da5e-bdf7-4a68-8ff6-3c6841624f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:01.099523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73dcb-9e4f-4004-afdb-306b7217bcad None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:01.099659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73da5e-bdf7-4a68-8ff6-3c6841624f96 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.099881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73da5e-bdf7-4a68-8ff6-3c6841624f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.100156 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73da5e-bdf7-4a68-8ff6-3c6841624f96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.101636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73da5e-bdf7-4a68-8ff6-3c6841624f96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:01.103034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73da5e-bdf7-4a68-8ff6-3c6841624f96 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:01.137143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:01.137798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.138092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.138358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.139069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] RBAC: Adding query filter params (name=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:01.139374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:01.140803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:01.145970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 509/1019] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:00 2022] GET /identity/v3/services?name=image => generated 123 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:01.152587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:01.246409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 511/1020] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:53:00 2022] POST /identity/v3/endpoints => generated 336 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:53:01.256925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:01.261869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990defd-65c4-437f-919e-1f056cd94f36 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:01.317310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970e7f3-dd46-47b2-9b85-c1d8ae3dbd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:01.318409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e7f3-dd46-47b2-9b85-c1d8ae3dbd6c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.318923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e7f3-dd46-47b2-9b85-c1d8ae3dbd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.319416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e7f3-dd46-47b2-9b85-c1d8ae3dbd6c None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.321046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970e7f3-dd46-47b2-9b85-c1d8ae3dbd6c None admin] RBAC: Adding query filter params (type=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:01.321598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970e7f3-dd46-47b2-9b85-c1d8ae3dbd6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:01.323204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970e7f3-dd46-47b2-9b85-c1d8ae3dbd6c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:01.329194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 510/1021] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:01 2022] GET /identity/v3/services?type=image => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:01.335953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73da5e-bdf7-4a68-8ff6-3c6841624f96 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:01.357457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9a6a-0f65-4453-980e-5f67206f9611 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.357993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9a6a-0f65-4453-980e-5f67206f9611 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.357993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9a6a-0f65-4453-980e-5f67206f9611 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.359423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 511/1022] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:53:01.365288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc1f5-075a-4769-a0ee-58b08a45872c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.365572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc1f5-075a-4769-a0ee-58b08a45872c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.365863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc1f5-075a-4769-a0ee-58b08a45872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.385163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-123bc1f5-075a-4769-a0ee-58b08a45872c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:01.386409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-123bc1f5-075a-4769-a0ee-58b08a45872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:01.460201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73da5e-bdf7-4a68-8ff6-3c6841624f96 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:01.464784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 512/1023] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:01 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:01.490294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:01.490479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc1f5-075a-4769-a0ee-58b08a45872c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:01.497486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:01.498148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.504573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.504573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.504573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] RBAC: Adding query filter params (interface=public, service_id=a2e6857f17e8487aa203fb11eb42d13c, region_id=RegionOne) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:01.504573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:01.504573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:01.506941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 512/1024] 10.222.0.123 () {56 vars in 1256 bytes} [Thu May 26 17:53:01 2022] GET /identity/v3/endpoints?service_id=a2e6857f17e8487aa203fb11eb42d13c&interface=public®ion_id=RegionOne => generated 195 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:01.513533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:01.603428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:01.613220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc1f5-075a-4769-a0ee-58b08a45872c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:01.623995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201c324-fb6b-4943-85a6-f81cd167ae1d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:01.656861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194df6-5865-4893-93b5-20a6d7a80648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:01.658001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194df6-5865-4893-93b5-20a6d7a80648 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.658609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194df6-5865-4893-93b5-20a6d7a80648 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.659158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6194df6-5865-4893-93b5-20a6d7a80648 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.660653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194df6-5865-4893-93b5-20a6d7a80648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:01.662133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6194df6-5865-4893-93b5-20a6d7a80648 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:01.662340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fa85e-0f42-48d4-b079-44b7bdc9ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:01.663267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa85e-0f42-48d4-b079-44b7bdc9ddc8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.664379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa85e-0f42-48d4-b079-44b7bdc9ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.664744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fa85e-0f42-48d4-b079-44b7bdc9ddc8 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.664877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 513/1025] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:01.665648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fa85e-0f42-48d4-b079-44b7bdc9ddc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:01.667020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fa85e-0f42-48d4-b079-44b7bdc9ddc8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:01.671888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194df6-5865-4893-93b5-20a6d7a80648 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:01.674175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 513/1026] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:53:01 2022] GET /identity/v3/services => generated 1966 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:53:01.783778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6194df6-5865-4893-93b5-20a6d7a80648 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:01.820999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f74d5-842a-4628-9119-895ce14b3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:01.821668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f74d5-842a-4628-9119-895ce14b3932 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:01.821943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f74d5-842a-4628-9119-895ce14b3932 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:01.822273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f74d5-842a-4628-9119-895ce14b3932 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:01.822993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f74d5-842a-4628-9119-895ce14b3932 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:01.824531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f74d5-842a-4628-9119-895ce14b3932 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:01.933768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 514/1027] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:53:01 2022] POST /identity/v3/projects => generated 312 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:53:03.618416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978d760-05cf-4904-aa6f-d9a5d90313dd None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:03.618911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978d760-05cf-4904-aa6f-d9a5d90313dd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:03.618911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978d760-05cf-4904-aa6f-d9a5d90313dd None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:03.620245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 514/1028] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:03.625986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de293d-7ffa-419e-8329-d220132b0a6a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:03.626391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de293d-7ffa-419e-8329-d220132b0a6a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:03.626586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de293d-7ffa-419e-8329-d220132b0a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:03.644061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-38de293d-7ffa-419e-8329-d220132b0a6a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:03.645301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-38de293d-7ffa-419e-8329-d220132b0a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:03.650283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:03.721856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 515/1029] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:03 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:03.747253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978d760-05cf-4904-aa6f-d9a5d90313dd None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:03.811376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:03.857814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978d760-05cf-4904-aa6f-d9a5d90313dd None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:03.893908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41c0e1-07e3-4f5f-ab09-4db689d463b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:03.894106 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc91c8-6fee-4f15-8a8f-6f6ea7ed9143 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:03.894377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc91c8-6fee-4f15-8a8f-6f6ea7ed9143 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:03.894631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c0e1-07e3-4f5f-ab09-4db689d463b2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:03.894730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc91c8-6fee-4f15-8a8f-6f6ea7ed9143 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:03.894909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c0e1-07e3-4f5f-ab09-4db689d463b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:03.895178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41c0e1-07e3-4f5f-ab09-4db689d463b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:03.896122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 516/1030] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:03.901057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e5518-ab8c-4178-98b9-b01d127b115c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:03.901337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e5518-ab8c-4178-98b9-b01d127b115c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:03.901608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e5518-ab8c-4178-98b9-b01d127b115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:03.906657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41c0e1-07e3-4f5f-ab09-4db689d463b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-cb41c0e1-07e3-4f5f-ab09-4db689d463b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:03.915750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:03.916726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:53:03.917564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:03.919675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-714e5518-ab8c-4178-98b9-b01d127b115c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:03.920776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 515/1031] 10.222.0.123 () {56 vars in 1125 bytes} [Thu May 26 17:53:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:03.921044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-714e5518-ab8c-4178-98b9-b01d127b115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:03.922829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41c0e1-07e3-4f5f-ab09-4db689d463b2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:03.990147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 517/1032] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:03 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:53:04.014897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e5518-ab8c-4178-98b9-b01d127b115c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.040675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41c0e1-07e3-4f5f-ab09-4db689d463b2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.058074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:04.075912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.076689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.076974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.077246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.077996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:04.078279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.079628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.089268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 516/1033] 10.222.0.123 () {56 vars in 1120 bytes} [Thu May 26 17:53:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:04.095090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.098852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:04.132812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e5518-ab8c-4178-98b9-b01d127b115c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.173914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.174767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.175047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.175317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] PATH_INFO: `/v3/services/image` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.175968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.177438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:04.189609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:04.190594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:04.191422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 518/1034] 10.222.0.123 () {56 vars in 1110 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:53:04.197302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.213211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1b99-ebf3-445e-b01a-66ff9c3aeffa None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.248722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268611-f036-4376-9408-ca0fb30e7b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.249598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268611-f036-4376-9408-ca0fb30e7b58 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.249815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268611-f036-4376-9408-ca0fb30e7b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.250059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268611-f036-4376-9408-ca0fb30e7b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.263115 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268611-f036-4376-9408-ca0fb30e7b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.264595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268611-f036-4376-9408-ca0fb30e7b58 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6e268611-f036-4376-9408-ca0fb30e7b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:53:04.283573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:04.284861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:04.285732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:53:04.285732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:53:04.285732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:04.285732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:04.285732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 517/1035] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:53:04.286069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bb55-df0c-42b2-a905-fc13f4665d41 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.286348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bb55-df0c-42b2-a905-fc13f4665d41 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.286622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bb55-df0c-42b2-a905-fc13f4665d41 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.287879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 518/1036] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:04 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:04.290590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5bb55-df0c-42b2-a905-fc13f4665d41 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.312827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00210d-dd72-4fa0-b1ef-5e455999673e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.324069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:04.348365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae5ad0-ed5f-41e5-9c5e-c723b1d4ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.349030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae5ad0-ed5f-41e5-9c5e-c723b1d4ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.349311 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae5ad0-ed5f-41e5-9c5e-c723b1d4ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.349586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae5ad0-ed5f-41e5-9c5e-c723b1d4ebb1 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.350287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae5ad0-ed5f-41e5-9c5e-c723b1d4ebb1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:04.350591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae5ad0-ed5f-41e5-9c5e-c723b1d4ebb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.352140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae5ad0-ed5f-41e5-9c5e-c723b1d4ebb1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.353235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:04.357478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 519/1037] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/services?name=image => generated 123 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:04.358646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1d3d-3aff-4ca2-ac99-8627ff1cf3aa None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.358929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1d3d-3aff-4ca2-ac99-8627ff1cf3aa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.359204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1d3d-3aff-4ca2-ac99-8627ff1cf3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.375310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-43fc1d3d-3aff-4ca2-ac99-8627ff1cf3aa None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:04.376681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-43fc1d3d-3aff-4ca2-ac99-8627ff1cf3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:04.399487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5bb55-df0c-42b2-a905-fc13f4665d41 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.435534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.436126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.436445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.436726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.437442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:04.437749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.439112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.443344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 520/1038] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:04 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:04.444174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1d3d-3aff-4ca2-ac99-8627ff1cf3aa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.461575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 519/1039] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:04.463606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.544051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1d3d-3aff-4ca2-ac99-8627ff1cf3aa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.556245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:04.564654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6d11a-45b8-43b9-bcc8-33ae25f22f1f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.571207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:04.579169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.579825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.580104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.580409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.581119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] RBAC: Adding query filter params (type=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:04.581420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.582794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.587784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 521/1040] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/services?type=image => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:04.588584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.599372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.600231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.600802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.601314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.610873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.612360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:53:04.626849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:04.628380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:04.629362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 520/1041] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:04.629982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.691731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b58e8-ffe7-4428-8526-fa0735458d17 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.727570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46d4ee-1a86-4dbc-8dab-cb175ac0e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.728370 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46d4ee-1a86-4dbc-8dab-cb175ac0e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.728655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46d4ee-1a86-4dbc-8dab-cb175ac0e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.728919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46d4ee-1a86-4dbc-8dab-cb175ac0e4d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.730077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46d4ee-1a86-4dbc-8dab-cb175ac0e4d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.731510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46d4ee-1a86-4dbc-8dab-cb175ac0e4d6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.731611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb9300-df6f-4859-ba9e-ec331148bcbf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.733317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 522/1042] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:04.733993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46d4ee-1a86-4dbc-8dab-cb175ac0e4d6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.770032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf84b86-381e-480d-b933-da5b999f7efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.770681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84b86-381e-480d-b933-da5b999f7efa None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.770957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84b86-381e-480d-b933-da5b999f7efa None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.771226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84b86-381e-480d-b933-da5b999f7efa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.771947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf84b86-381e-480d-b933-da5b999f7efa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.774026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf84b86-381e-480d-b933-da5b999f7efa None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.793822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:04.832037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46d4ee-1a86-4dbc-8dab-cb175ac0e4d6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:04.865580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 521/1043] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:53:04 2022] POST /identity/v3/endpoints => generated 329 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:53:04.866467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf84b86-381e-480d-b933-da5b999f7efa None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:04.875779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:04.875779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:04.875779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:04.875779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:04.876438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:04.876659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:04.878210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:04.881381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:04.909714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 523/1044] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:04.911222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:05.008967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf84b86-381e-480d-b933-da5b999f7efa None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:05.030238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c46bd3-863d-49a6-90d8-644d77366f92 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:05.046578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:05.051099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78c78-fbcc-44ef-920c-129715ba234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:05.051778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78c78-fbcc-44ef-920c-129715ba234a None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:05.052058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78c78-fbcc-44ef-920c-129715ba234a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:05.052356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78c78-fbcc-44ef-920c-129715ba234a None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:05.053067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d78c78-fbcc-44ef-920c-129715ba234a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:05.054538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d78c78-fbcc-44ef-920c-129715ba234a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:05.069028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe023-d0df-4bee-952e-a30951dac8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:05.070198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe023-d0df-4bee-952e-a30951dac8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:05.070614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe023-d0df-4bee-952e-a30951dac8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:05.070894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe023-d0df-4bee-952e-a30951dac8f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:05.141039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbe023-d0df-4bee-952e-a30951dac8f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:05.142890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbe023-d0df-4bee-952e-a30951dac8f2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:05.192340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 522/1045] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:53:04 2022] POST /identity/v3/users => generated 286 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:53:05.261136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 524/1046] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:04 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:53:05.267473 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78c78-fbcc-44ef-920c-129715ba234a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:05.346919 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:05.391239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78c78-fbcc-44ef-920c-129715ba234a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:05.427975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:05.430335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:05.430618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:05.430892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:05.442719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:05.444167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:53:05.463983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:05.465099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:05.466197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:53:05.466197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:53:05.466197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:05.466197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:05.466197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 523/1047] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:05.472871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe023-d0df-4bee-952e-a30951dac8f2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:05.489469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:05.578036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe023-d0df-4bee-952e-a30951dac8f2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:05.614187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:05.615221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:05.615707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:05.616174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:05.617441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:05.617924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:05.619389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:05.632435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 525/1048] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:53:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:05.640067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:05.749090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94962-f519-45ed-89d2-e52d65f16746 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:05.769316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:05.787924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:05.789582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:05.790013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:05.790429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:05.797342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:05.798954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:53:05.814292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:05.815274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:05.816210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:53:05.816210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:53:05.816210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:53:05.816210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:53:05.816210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:53:05.816210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:53:05.816210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:53:05.816210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:05.816947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 524/1049] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:53:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:05.823531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:05.903635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:05.930006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75cb08-c5ea-4435-a295-da4432e788f7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:05.972247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dfa86-d47a-4f25-a8c1-2f68c1f375d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:05.972923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dfa86-d47a-4f25-a8c1-2f68c1f375d9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:05.973206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dfa86-d47a-4f25-a8c1-2f68c1f375d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:05.973477 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dfa86-d47a-4f25-a8c1-2f68c1f375d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:05.974261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dfa86-d47a-4f25-a8c1-2f68c1f375d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:05.974569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dfa86-d47a-4f25-a8c1-2f68c1f375d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:05.976022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dfa86-d47a-4f25-a8c1-2f68c1f375d9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:05.995643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 526/1050] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:53:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:05.997003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:06.108427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc6e9b-f88f-4e6b-9129-9b1ff886cff1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:06.145401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69047c-5fc0-4ab9-b158-f16ec1715bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:06.146131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69047c-5fc0-4ab9-b158-f16ec1715bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:06.146415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69047c-5fc0-4ab9-b158-f16ec1715bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:06.146686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69047c-5fc0-4ab9-b158-f16ec1715bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:06.147516 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69047c-5fc0-4ab9-b158-f16ec1715bb2 None admin] RBAC: Adding query filter params (role.id=21232936df264a9aa7d922b5d4f5eb05, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=6fd75bf129c642a89153efcb584406d8) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:06.147824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69047c-5fc0-4ab9-b158-f16ec1715bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:06.149946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69047c-5fc0-4ab9-b158-f16ec1715bb2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:06.161420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 525/1051] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:05 2022] GET /identity/v3/role_assignments?user.id=6fd75bf129c642a89153efcb584406d8&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=21232936df264a9aa7d922b5d4f5eb05 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:07.132462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a15651-ce18-4b7b-8067-030428faf32f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.132986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a15651-ce18-4b7b-8067-030428faf32f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.132986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a15651-ce18-4b7b-8067-030428faf32f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.134512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 527/1052] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:07.139791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e2b1-e03d-46a9-b6a3-440a128c3226 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.140170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e2b1-e03d-46a9-b6a3-440a128c3226 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.140392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e2b1-e03d-46a9-b6a3-440a128c3226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.157557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1134e2b1-e03d-46a9-b6a3-440a128c3226 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:07.158768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1134e2b1-e03d-46a9-b6a3-440a128c3226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:07.193766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:07.228918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 526/1053] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:07 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:07.251130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a15651-ce18-4b7b-8067-030428faf32f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:07.372726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a15651-ce18-4b7b-8067-030428faf32f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:07.410060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016910f-27c4-429b-a656-b89e920e447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:07.410605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016910f-27c4-429b-a656-b89e920e447a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.410884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016910f-27c4-429b-a656-b89e920e447a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.411152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016910f-27c4-429b-a656-b89e920e447a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.414412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:07.474679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260bb27-a7b9-4e99-aaaf-ebf3d69a235c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.474992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260bb27-a7b9-4e99-aaaf-ebf3d69a235c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.475240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260bb27-a7b9-4e99-aaaf-ebf3d69a235c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.477386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 527/1054] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:53:07.483226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eff241-9788-4183-851e-7f103eb93326 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.483512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eff241-9788-4183-851e-7f103eb93326 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.483786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eff241-9788-4183-851e-7f103eb93326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.483888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016910f-27c4-429b-a656-b89e920e447a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:07.485349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016910f-27c4-429b-a656-b89e920e447a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:07.504888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d7eff241-9788-4183-851e-7f103eb93326 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:07.506074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d7eff241-9788-4183-851e-7f103eb93326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:07.589773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 528/1055] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:07 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:53:07.591397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 528/1056] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:07 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:07.597406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eff241-9788-4183-851e-7f103eb93326 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:07.615730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016910f-27c4-429b-a656-b89e920e447a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:07.651980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:07.721181 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016910f-27c4-429b-a656-b89e920e447a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:07.722086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:07.724873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eff241-9788-4183-851e-7f103eb93326 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:07.758552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7423402-b0ed-411d-9fef-946a844dbe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:07.759601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7423402-b0ed-411d-9fef-946a844dbe1f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.759874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7423402-b0ed-411d-9fef-946a844dbe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.760152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7423402-b0ed-411d-9fef-946a844dbe1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.763031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:07.763820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.764102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.764405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.771462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7423402-b0ed-411d-9fef-946a844dbe1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:07.775891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:07.777371 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a7423402-b0ed-411d-9fef-946a844dbe1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:07.779332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:07.780231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:07.781096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:07.785641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 529/1057] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:53:07.786283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7423402-b0ed-411d-9fef-946a844dbe1f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:53:07.798219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:07.799158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:07.800036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:53:07.800036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:53:07.800036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:07.800036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:07.800036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 529/1058] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:53:07.805711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:07.893583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:07.900897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7423402-b0ed-411d-9fef-946a844dbe1f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:07.910797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94abd2-862e-464b-a529-7b283e3c7aab None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:07.935377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:07.936038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.936726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.937351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.938348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:07.939144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:07.940539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:07.949665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:07.950332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:07.950612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:07.950883 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:07.951606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:07.951914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:07.953341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:07.955485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 530/1059] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:53:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:07.956237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:07.965706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 530/1060] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:53:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:08.080903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11218e-d5f4-4c8c-9f3d-be9ec90b8992 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:08.120467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab5aa7-051f-492a-914f-61e4212c27bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:08.121341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab5aa7-051f-492a-914f-61e4212c27bd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.121615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab5aa7-051f-492a-914f-61e4212c27bd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.121946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab5aa7-051f-492a-914f-61e4212c27bd None admin] PATH_INFO: `/v3/users/1d5dfa11145741e499de8fbfe4523ecf` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.137666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab5aa7-051f-492a-914f-61e4212c27bd None admin] RBAC: Authorizing `identity:get_user(user_id=1d5dfa11145741e499de8fbfe4523ecf)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:08.139152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab5aa7-051f-492a-914f-61e4212c27bd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:08.147380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 531/1061] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:07 2022] GET /identity/v3/users/1d5dfa11145741e499de8fbfe4523ecf => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:08.147584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:08.164328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:08.259887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0e37e-7034-4bb3-93a7-f7d6d41e7547 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:08.297731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb5e1c-1f3b-4be3-acd0-ca379b580228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:08.298383 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5e1c-1f3b-4be3-acd0-ca379b580228 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.298658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5e1c-1f3b-4be3-acd0-ca379b580228 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.298925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5e1c-1f3b-4be3-acd0-ca379b580228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.368362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb5e1c-1f3b-4be3-acd0-ca379b580228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:08.369739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb5e1c-1f3b-4be3-acd0-ca379b580228 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:08.383213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:08.411527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760382c-82d9-49ee-bcde-8c5b434cf96f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.411812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760382c-82d9-49ee-bcde-8c5b434cf96f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.412092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760382c-82d9-49ee-bcde-8c5b434cf96f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.413509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 532/1062] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:08.419193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d3f42-b19d-4c7f-9e4e-fa788e3bef48 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.419480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d3f42-b19d-4c7f-9e4e-fa788e3bef48 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.419762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d3f42-b19d-4c7f-9e4e-fa788e3bef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.436088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a66d3f42-b19d-4c7f-9e4e-fa788e3bef48 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:08.437304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a66d3f42-b19d-4c7f-9e4e-fa788e3bef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:08.446790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:08.468891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 531/1063] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:08 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:08.474628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb5e1c-1f3b-4be3-acd0-ca379b580228 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:08.504384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 533/1064] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:08 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:53:08.527756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d3f42-b19d-4c7f-9e4e-fa788e3bef48 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:08.575572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb5e1c-1f3b-4be3-acd0-ca379b580228 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:08.590063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:08.612509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8df3f-a86c-4de2-b3be-26506262dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:08.613392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8df3f-a86c-4de2-b3be-26506262dea7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.613674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8df3f-a86c-4de2-b3be-26506262dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.613951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8df3f-a86c-4de2-b3be-26506262dea7 None admin] PATH_INFO: `/v3/projects/4af1bf290524445687476694994d9b85` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.615131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8df3f-a86c-4de2-b3be-26506262dea7 None admin] RBAC: Authorizing `identity:get_project(project_id=4af1bf290524445687476694994d9b85)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:08.616603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8df3f-a86c-4de2-b3be-26506262dea7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:08.618647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 532/1065] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:08 2022] GET /identity/v3/projects/4af1bf290524445687476694994d9b85 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:08.624922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8df3f-a86c-4de2-b3be-26506262dea7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:08.629452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d3f42-b19d-4c7f-9e4e-fa788e3bef48 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:08.665511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8540-5ec3-4c14-a20f-12c8edcc7dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:08.666309 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8540-5ec3-4c14-a20f-12c8edcc7dfc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.666622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8540-5ec3-4c14-a20f-12c8edcc7dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.667327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8540-5ec3-4c14-a20f-12c8edcc7dfc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.677289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e8540-5ec3-4c14-a20f-12c8edcc7dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f25e8540-5ec3-4c14-a20f-12c8edcc7dfc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:08.685609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:08.686696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:08.687570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 534/1066] 10.222.0.123 () {56 vars in 1125 bytes} [Thu May 26 17:53:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:53:08.692707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8540-5ec3-4c14-a20f-12c8edcc7dfc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:08.696951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:08.730333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8df3f-a86c-4de2-b3be-26506262dea7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:08.765295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:08.765945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.766227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.766504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.767320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=4af1bf290524445687476694994d9b85, user.id=1d5dfa11145741e499de8fbfe4523ecf) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:08.767632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:08.769085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:08.775308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 533/1067] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:08 2022] GET /identity/v3/role_assignments?user.id=1d5dfa11145741e499de8fbfe4523ecf&scope.project.id=4af1bf290524445687476694994d9b85&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:08.794984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8540-5ec3-4c14-a20f-12c8edcc7dfc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:08.831990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:08.832703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.832987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.833262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:08.834030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:08.834341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:08.836477 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:08.845920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 535/1068] 10.222.0.123 () {56 vars in 1120 bytes} [Thu May 26 17:53:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:08.852039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:08.902170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:08.960397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeee06-2bab-4970-81fa-85bd9bdea7d5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:08.995008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:08.995818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:08.996100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:08.996399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:09.007157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:09.009204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:53:09.027477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:09.028405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:09.029491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:53:09.029491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:53:09.029491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:09.029491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:09.032477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 534/1069] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:09.034676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:09.100572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:09.202919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c31e3e-4209-4958-9da2-a589ae6b2a09 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:09.236438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:09.237090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:09.237369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:09.237641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:09.238356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:09.238660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:09.240034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:09.252911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 536/1070] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:53:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:09.259185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:09.353851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:09.359615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449e87e-a1ea-4a61-9f4f-b6d1e6fe1f15 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:09.394727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:09.395510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:09.395785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:09.396055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:09.403398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:09.404892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:53:09.418950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:09.419895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:09.420894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 535/1071] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:53:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:09.426011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:09.528024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fae3b-bbeb-4390-9d26-eaf94c8ef6a9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:09.555926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:09.564214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:09.564945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:09.565223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:09.565499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:09.571557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:09.571557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:09.571557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:09.585962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 537/1072] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:53:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:09.592272 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:09.692706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb93ee-4e2f-4716-8393-9b1026c122c7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:09.725736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:09.727041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:09.727322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:09.727595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:09.738170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:09.739601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:53:09.757365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:09.758372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:09.759239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:53:09.759239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:53:09.759239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:09.759239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:09.759239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 536/1073] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:09.764704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:09.862721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c5549-41e6-45bb-82af-5c1d57c81fc6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:09.897806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:09.899236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:09.899379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:09.899622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:09.900351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:09.900656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:09.902014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:09.913215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 538/1074] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:53:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:09.919704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:09.931262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:10.018994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6e4d0-4adf-4719-afd6-f575bb6fed88 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:10.053242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:10.054035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:10.054343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:10.055149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:10.061786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:10.063218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:53:10.077947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:10.079030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:10.080442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 537/1075] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:10.084967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:10.149071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:10.203451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eace4-3e9f-4b42-8d1e-21d5a03c9176 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:10.236140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb283-5b1a-4fcc-9667-81b93c635318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:10.236811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb283-5b1a-4fcc-9667-81b93c635318 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:10.237088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb283-5b1a-4fcc-9667-81b93c635318 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:10.237356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb283-5b1a-4fcc-9667-81b93c635318 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:10.238121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb283-5b1a-4fcc-9667-81b93c635318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:10.238426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb283-5b1a-4fcc-9667-81b93c635318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:10.239840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb283-5b1a-4fcc-9667-81b93c635318 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:10.251676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 539/1076] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:10.258719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:10.330643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:10.364541 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01aaf6-f0c8-4584-baef-29b80b57ecca None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:10.399929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaf2bf-d80c-44d2-aa66-77dc0391b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:10.400771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf2bf-d80c-44d2-aa66-77dc0391b256 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:10.401051 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf2bf-d80c-44d2-aa66-77dc0391b256 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:10.401324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaf2bf-d80c-44d2-aa66-77dc0391b256 None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/6fd75bf129c642a89153efcb584406d8/roles/21232936df264a9aa7d922b5d4f5eb05` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:10.403498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaf2bf-d80c-44d2-aa66-77dc0391b256 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=6fd75bf129c642a89153efcb584406d8, role_id=21232936df264a9aa7d922b5d4f5eb05)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:10.404968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaf2bf-d80c-44d2-aa66-77dc0391b256 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:10.516117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 538/1077] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:53:10 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/6fd75bf129c642a89153efcb584406d8/roles/21232936df264a9aa7d922b5d4f5eb05 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:53:10.971810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3907d3-391d-4302-b124-57d7173621de None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:10.972092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3907d3-391d-4302-b124-57d7173621de None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:10.972395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3907d3-391d-4302-b124-57d7173621de None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:10.973775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 540/1078] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:10.979769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56b21-f7a0-4e50-9596-4a9d7fbfb72d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:10.980053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56b21-f7a0-4e50-9596-4a9d7fbfb72d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:10.980349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56b21-f7a0-4e50-9596-4a9d7fbfb72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:10.997300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-41f56b21-f7a0-4e50-9596-4a9d7fbfb72d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:10.998479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-41f56b21-f7a0-4e50-9596-4a9d7fbfb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:11.066727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 539/1079] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:10 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:11.089011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3907d3-391d-4302-b124-57d7173621de None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:11.245253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3907d3-391d-4302-b124-57d7173621de None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:11.247557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:11.278676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5a90-a589-4f7f-bb45-246e0b7e165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:11.279486 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5a90-a589-4f7f-bb45-246e0b7e165a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:11.279769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5a90-a589-4f7f-bb45-246e0b7e165a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:11.280040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5a90-a589-4f7f-bb45-246e0b7e165a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:11.295135 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c5a90-a589-4f7f-bb45-246e0b7e165a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a27c5a90-a589-4f7f-bb45-246e0b7e165a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:11.303083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:11.304125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:11.306426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 541/1080] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:53:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:11.310836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56b21-f7a0-4e50-9596-4a9d7fbfb72d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:11.368010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:11.409252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56b21-f7a0-4e50-9596-4a9d7fbfb72d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:11.443645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:11.444344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:11.444610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:11.444881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:11.445729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:11.446032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:11.447413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:11.455509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 540/1081] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:53:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:11.461906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5a90-a589-4f7f-bb45-246e0b7e165a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:11.560719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5a90-a589-4f7f-bb45-246e0b7e165a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:11.593422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48f55f-5c45-4310-9adb-d7528bc6ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:11.594276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48f55f-5c45-4310-9adb-d7528bc6ce1f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:11.594555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48f55f-5c45-4310-9adb-d7528bc6ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:11.594827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48f55f-5c45-4310-9adb-d7528bc6ce1f None admin] PATH_INFO: `/v3/users/1d5dfa11145741e499de8fbfe4523ecf` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:11.596009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48f55f-5c45-4310-9adb-d7528bc6ce1f None admin] RBAC: Authorizing `identity:get_user(user_id=1d5dfa11145741e499de8fbfe4523ecf)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:11.597508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48f55f-5c45-4310-9adb-d7528bc6ce1f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:11.599282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 542/1082] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:11 2022] GET /identity/v3/users/1d5dfa11145741e499de8fbfe4523ecf => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:11.605765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:11.714621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f3c57-dea3-4103-96dd-26d5747a7e04 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:11.735558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:11.750236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cd0c3-1d08-48d9-90a9-7960ad4c5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:11.751097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cd0c3-1d08-48d9-90a9-7960ad4c5972 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:11.751375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cd0c3-1d08-48d9-90a9-7960ad4c5972 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:11.751646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cd0c3-1d08-48d9-90a9-7960ad4c5972 None admin] PATH_INFO: `/v3/projects/4af1bf290524445687476694994d9b85` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:11.752859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cd0c3-1d08-48d9-90a9-7960ad4c5972 None admin] RBAC: Authorizing `identity:get_project(project_id=4af1bf290524445687476694994d9b85)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:11.754278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cd0c3-1d08-48d9-90a9-7960ad4c5972 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:11.755979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 541/1083] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:11 2022] GET /identity/v3/projects/4af1bf290524445687476694994d9b85 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:11.763115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48f55f-5c45-4310-9adb-d7528bc6ce1f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:11.795276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:11.864956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48f55f-5c45-4310-9adb-d7528bc6ce1f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:11.899412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab848ed-e9b2-4d51-a3c5-0eff1c80b289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:11.900284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab848ed-e9b2-4d51-a3c5-0eff1c80b289 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:11.900599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab848ed-e9b2-4d51-a3c5-0eff1c80b289 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:11.900873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab848ed-e9b2-4d51-a3c5-0eff1c80b289 None admin] PATH_INFO: `/v3/projects/4af1bf290524445687476694994d9b85/users/1d5dfa11145741e499de8fbfe4523ecf/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:11.902824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab848ed-e9b2-4d51-a3c5-0eff1c80b289 None admin] RBAC: Authorizing `identity:create_grant(project_id=4af1bf290524445687476694994d9b85, user_id=1d5dfa11145741e499de8fbfe4523ecf, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:11.904267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab848ed-e9b2-4d51-a3c5-0eff1c80b289 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:11.979169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 543/1084] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:53:11 2022] PUT /identity/v3/projects/4af1bf290524445687476694994d9b85/users/1d5dfa11145741e499de8fbfe4523ecf/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:53:12.854603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc7f3-d57b-49c4-9f5d-feedfa964647 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:12.855136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc7f3-d57b-49c4-9f5d-feedfa964647 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:12.855136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc7f3-d57b-49c4-9f5d-feedfa964647 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:12.856563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 542/1085] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:12.861810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b5fe-db9e-45c6-aa07-a234e69bc8d4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:12.862219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b5fe-db9e-45c6-aa07-a234e69bc8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:12.862350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702b5fe-db9e-45c6-aa07-a234e69bc8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:12.879409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c702b5fe-db9e-45c6-aa07-a234e69bc8d4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:12.880617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c702b5fe-db9e-45c6-aa07-a234e69bc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:12.947530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 544/1086] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:12 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:12.971127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fc7f3-d57b-49c4-9f5d-feedfa964647 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:13.071581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fc7f3-d57b-49c4-9f5d-feedfa964647 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:13.105535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aad538-41e3-4ff1-adb2-953119a22800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:13.106278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aad538-41e3-4ff1-adb2-953119a22800 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:13.106563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aad538-41e3-4ff1-adb2-953119a22800 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:13.106837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aad538-41e3-4ff1-adb2-953119a22800 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:13.118689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aad538-41e3-4ff1-adb2-953119a22800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-50aad538-41e3-4ff1-adb2-953119a22800 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:13.131553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:13.132482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:13.134179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 543/1087] 10.222.0.123 () {56 vars in 1125 bytes} [Thu May 26 17:53:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:13.135579 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702b5fe-db9e-45c6-aa07-a234e69bc8d4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:13.158974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:13.234618 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702b5fe-db9e-45c6-aa07-a234e69bc8d4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:13.268640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:13.269297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:13.269578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:13.269850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:13.270586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:13.270890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:13.272255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:13.280479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 545/1088] 10.222.0.123 () {56 vars in 1120 bytes} [Thu May 26 17:53:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:13.285896 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aad538-41e3-4ff1-adb2-953119a22800 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:13.336438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:13.387880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aad538-41e3-4ff1-adb2-953119a22800 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:13.423546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:13.424344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:13.424624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:13.424894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:13.438457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:13.441010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:53:13.460499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:13.461574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:13.462429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:53:13.462429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:53:13.462429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:13.462429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:13.462429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 544/1089] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:13.467626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:13.555590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:13.571113 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127b5c5-5cf3-4d6c-872a-9ea4d468675a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:13.608391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:13.609154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:13.609485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:13.609871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:13.610663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:13.611037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:13.612528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:13.624628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 546/1090] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:53:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:13.630133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:13.728564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:13.731466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183459-80ef-4d9d-90e8-96aa846a984f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:13.765505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:13.766285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:13.766563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:13.766834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:13.774731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:13.776177 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:53:13.790168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:13.791378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:13.792352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 545/1091] 10.222.0.123 () {56 vars in 1098 bytes} [Thu May 26 17:53:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:13.797291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:13.896478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f41f2-e853-47f2-9db7-040721e78eae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:13.929232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac6bd-ebbc-446c-b2d8-4ee8b00cfbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:13.930451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac6bd-ebbc-446c-b2d8-4ee8b00cfbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:13.930739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac6bd-ebbc-446c-b2d8-4ee8b00cfbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:13.931011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac6bd-ebbc-446c-b2d8-4ee8b00cfbe1 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:13.931843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac6bd-ebbc-446c-b2d8-4ee8b00cfbe1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:13.932152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac6bd-ebbc-446c-b2d8-4ee8b00cfbe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:13.933619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac6bd-ebbc-446c-b2d8-4ee8b00cfbe1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:13.951583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 547/1092] 10.222.0.123 () {56 vars in 1138 bytes} [Thu May 26 17:53:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:13.957133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.062176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12860a02-da05-436e-b663-ad2f9780250b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.097721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eefe30-2a48-4f8e-9631-70d2f8446396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.098370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eefe30-2a48-4f8e-9631-70d2f8446396 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.098648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eefe30-2a48-4f8e-9631-70d2f8446396 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.098917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eefe30-2a48-4f8e-9631-70d2f8446396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.128444 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.169011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eefe30-2a48-4f8e-9631-70d2f8446396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:14.170479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eefe30-2a48-4f8e-9631-70d2f8446396 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:14.235932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fbf0a-f0e1-4510-a0d3-74cf2fb3ce1c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.236274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fbf0a-f0e1-4510-a0d3-74cf2fb3ce1c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.236593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fbf0a-f0e1-4510-a0d3-74cf2fb3ce1c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.237973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 548/1093] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 17:53:14.243794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe79b6-64f4-49c8-bc88-8f1a28dc6431 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.244077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe79b6-64f4-49c8-bc88-8f1a28dc6431 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.244383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe79b6-64f4-49c8-bc88-8f1a28dc6431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.249398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.261686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1dfe79b6-64f4-49c8-bc88-8f1a28dc6431 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:14.262865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1dfe79b6-64f4-49c8-bc88-8f1a28dc6431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:14.272382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 546/1094] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:13 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:14.278490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eefe30-2a48-4f8e-9631-70d2f8446396 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.334394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 549/1095] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:14 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:53:14.340840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.359322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe79b6-64f4-49c8-bc88-8f1a28dc6431 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.384564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eefe30-2a48-4f8e-9631-70d2f8446396 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.419912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.420863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.421198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.421529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.433184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:14.435003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:53:14.453402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:14.454396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:14.455320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:53:14.455320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:53:14.455320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:53:14.455320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:14.455320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 547/1096] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:53:14.460184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.464800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe79b6-64f4-49c8-bc88-8f1a28dc6431 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.494930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.500368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3beb-805f-4cff-93be-31f6add17361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.501149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3beb-805f-4cff-93be-31f6add17361 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.501431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3beb-805f-4cff-93be-31f6add17361 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.501699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3beb-805f-4cff-93be-31f6add17361 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.514764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d3beb-805f-4cff-93be-31f6add17361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-dd9d3beb-805f-4cff-93be-31f6add17361 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:14.523565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:14.524647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:14.525478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 550/1097] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:53:14.532581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3beb-805f-4cff-93be-31f6add17361 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.561245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8cb3c-dc09-494f-a03d-36900d284554 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.575286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.596016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.596636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.596914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.597183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.597889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:14.598193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:14.599559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:14.612253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 548/1098] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:14.618757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.644937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3beb-805f-4cff-93be-31f6add17361 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.679192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.680499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.680784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.681063 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.681836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:14.682147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:14.683543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:14.691783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 551/1099] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:14.698100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.717897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28418-59ac-4070-9b36-4f5b94d81f59 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.751945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.755537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.756350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.756641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.756916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.765003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:14.766600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:53:14.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:14.782922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:14.783800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 549/1100] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:14.789475 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.801054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a229-9948-4629-9baa-19ef4beec524 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.821141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.834739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc0a01-64ff-49fd-893d-5e73d5768fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.835604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0a01-64ff-49fd-893d-5e73d5768fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.835956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0a01-64ff-49fd-893d-5e73d5768fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.836294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0a01-64ff-49fd-893d-5e73d5768fa0 None admin] PATH_INFO: `/v3/users/1d5dfa11145741e499de8fbfe4523ecf` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.837542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc0a01-64ff-49fd-893d-5e73d5768fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=1d5dfa11145741e499de8fbfe4523ecf)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:14.838979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc0a01-64ff-49fd-893d-5e73d5768fa0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:14.840732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 552/1101] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/users/1d5dfa11145741e499de8fbfe4523ecf => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:14.846482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc0a01-64ff-49fd-893d-5e73d5768fa0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.904985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363be75-2c88-4034-b242-d75a9c7802be None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.940352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.941104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.941388 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.941662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:14.942440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:14.942749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:14.944182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:14.946917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc0a01-64ff-49fd-893d-5e73d5768fa0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:14.956279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 550/1102] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:14.962625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:14.969948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:14.981743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4b16-e129-4a54-9437-54eacbdd34c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:14.982387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4b16-e129-4a54-9437-54eacbdd34c1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:14.982670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4b16-e129-4a54-9437-54eacbdd34c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:14.989687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4b16-e129-4a54-9437-54eacbdd34c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:15.052839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f4b16-e129-4a54-9437-54eacbdd34c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:15.054287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f4b16-e129-4a54-9437-54eacbdd34c1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:15.060782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:15.069827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf9ba8-29c7-4c82-ad4e-826b90fb48dd None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:15.105255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:15.105839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:15.106123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:15.106399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:15.107221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] RBAC: Adding query filter params (role.id=21232936df264a9aa7d922b5d4f5eb05, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=6fd75bf129c642a89153efcb584406d8) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:15.107547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:15.109010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:15.115530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 551/1103] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/role_assignments?user.id=6fd75bf129c642a89153efcb584406d8&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=21232936df264a9aa7d922b5d4f5eb05 => generated 610 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:15.175603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 553/1104] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:14 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 17:53:15.177026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:15.293529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58849787-94ce-4736-8802-8ef9b0ed14d5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:15.330821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc103b7-a5c0-4fee-88b5-fb47d057b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:15.331808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc103b7-a5c0-4fee-88b5-fb47d057b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:15.332138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc103b7-a5c0-4fee-88b5-fb47d057b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:15.332484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc103b7-a5c0-4fee-88b5-fb47d057b1f2 None admin] PATH_INFO: `/v3/projects/4af1bf290524445687476694994d9b85` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:15.333671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc103b7-a5c0-4fee-88b5-fb47d057b1f2 None admin] RBAC: Authorizing `identity:get_project(project_id=4af1bf290524445687476694994d9b85)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:15.335080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc103b7-a5c0-4fee-88b5-fb47d057b1f2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:15.337515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 552/1105] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:15 2022] GET /identity/v3/projects/4af1bf290524445687476694994d9b85 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:15.343878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4b16-e129-4a54-9437-54eacbdd34c1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:15.369678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:15.450029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4b16-e129-4a54-9437-54eacbdd34c1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:15.485871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd1215-5a9d-4e70-8e85-8c0912dc7c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:15.486523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd1215-5a9d-4e70-8e85-8c0912dc7c6c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:15.486806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd1215-5a9d-4e70-8e85-8c0912dc7c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:15.487085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd1215-5a9d-4e70-8e85-8c0912dc7c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:15.487928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd1215-5a9d-4e70-8e85-8c0912dc7c6c None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=4af1bf290524445687476694994d9b85, user.id=1d5dfa11145741e499de8fbfe4523ecf) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:15.488239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd1215-5a9d-4e70-8e85-8c0912dc7c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:15.489765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd1215-5a9d-4e70-8e85-8c0912dc7c6c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:15.496035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 554/1106] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:15 2022] GET /identity/v3/role_assignments?user.id=1d5dfa11145741e499de8fbfe4523ecf&scope.project.id=4af1bf290524445687476694994d9b85&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 610 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:17.794217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a633-668f-4bd7-a668-b68493c7f4d9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:17.794740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a633-668f-4bd7-a668-b68493c7f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:17.794740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a633-668f-4bd7-a668-b68493c7f4d9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:17.796118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 553/1107] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:17.801374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701cd0f-b857-4911-b88c-b85c439b304f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:17.801799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701cd0f-b857-4911-b88c-b85c439b304f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:17.801921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701cd0f-b857-4911-b88c-b85c439b304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:17.818902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4701cd0f-b857-4911-b88c-b85c439b304f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:17.820077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4701cd0f-b857-4911-b88c-b85c439b304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:17.884749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 555/1108] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:17 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:17.909425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270a633-668f-4bd7-a668-b68493c7f4d9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:17.936348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:18.010393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270a633-668f-4bd7-a668-b68493c7f4d9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:18.043178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c45d74-c841-49bd-827d-07399350b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:18.043945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c45d74-c841-49bd-827d-07399350b00a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:18.044269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c45d74-c841-49bd-827d-07399350b00a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:18.044520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c45d74-c841-49bd-827d-07399350b00a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:18.045653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c45d74-c841-49bd-827d-07399350b00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:18.047058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c45d74-c841-49bd-827d-07399350b00a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:18.048679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 554/1109] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:18.054310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701cd0f-b857-4911-b88c-b85c439b304f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:18.072107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:18.152329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701cd0f-b857-4911-b88c-b85c439b304f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:18.185372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af023e-bb72-43f6-a62d-1edbfd3fd756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:18.186028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af023e-bb72-43f6-a62d-1edbfd3fd756 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:18.186302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af023e-bb72-43f6-a62d-1edbfd3fd756 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:18.186573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af023e-bb72-43f6-a62d-1edbfd3fd756 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:18.187283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af023e-bb72-43f6-a62d-1edbfd3fd756 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:18.188824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af023e-bb72-43f6-a62d-1edbfd3fd756 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:18.288885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 556/1110] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:53:18 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:53:20.522544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a028c-0db8-4519-85e2-6c3884ab13da None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:20.523070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a028c-0db8-4519-85e2-6c3884ab13da None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:20.523188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a028c-0db8-4519-85e2-6c3884ab13da None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:20.524652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 555/1111] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:20.529824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79030b6-0b90-4c96-96a7-7459aaa9434c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:20.530219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79030b6-0b90-4c96-96a7-7459aaa9434c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:20.530360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79030b6-0b90-4c96-96a7-7459aaa9434c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:20.546660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b79030b6-0b90-4c96-96a7-7459aaa9434c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:20.547826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b79030b6-0b90-4c96-96a7-7459aaa9434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:20.612582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 557/1112] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:20 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:20.636879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a028c-0db8-4519-85e2-6c3884ab13da None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:20.728571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:20.737788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a028c-0db8-4519-85e2-6c3884ab13da None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:20.770690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20ec40-bd9c-48d5-8190-13cccf282f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:20.771530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ec40-bd9c-48d5-8190-13cccf282f5d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:20.771828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ec40-bd9c-48d5-8190-13cccf282f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:20.772095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ec40-bd9c-48d5-8190-13cccf282f5d None admin] PATH_INFO: `/v3/roles/6b666ed01b97482497ff1f656ecff898` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:20.773557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20ec40-bd9c-48d5-8190-13cccf282f5d None admin] RBAC: Authorizing `identity:get_role(role_id=6b666ed01b97482497ff1f656ecff898)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:20.775038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20ec40-bd9c-48d5-8190-13cccf282f5d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:20.776430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 556/1113] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:20 2022] GET /identity/v3/roles/6b666ed01b97482497ff1f656ecff898 => generated 224 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:20.782362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79030b6-0b90-4c96-96a7-7459aaa9434c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:20.784653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:20.883812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79030b6-0b90-4c96-96a7-7459aaa9434c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:20.916458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ba424-9571-42b1-84ba-2d0ccc24fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:20.917314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ba424-9571-42b1-84ba-2d0ccc24fca1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:20.917592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ba424-9571-42b1-84ba-2d0ccc24fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:20.917861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ba424-9571-42b1-84ba-2d0ccc24fca1 None admin] PATH_INFO: `/v3/users/7f5afe81e972480c9f63ce700987e377` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:20.930943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ba424-9571-42b1-84ba-2d0ccc24fca1 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5afe81e972480c9f63ce700987e377)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:20.932408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ba424-9571-42b1-84ba-2d0ccc24fca1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:20.934045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 558/1114] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:20 2022] GET /identity/v3/users/7f5afe81e972480c9f63ce700987e377 => generated 287 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:20.939871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20ec40-bd9c-48d5-8190-13cccf282f5d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:21.036060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20ec40-bd9c-48d5-8190-13cccf282f5d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:21.069622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b3aac-f40e-4e3a-b11b-bfe75fafde78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:21.070215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3aac-f40e-4e3a-b11b-bfe75fafde78 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:21.074521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3aac-f40e-4e3a-b11b-bfe75fafde78 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:21.074521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3aac-f40e-4e3a-b11b-bfe75fafde78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:21.098419 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:21.139685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b3aac-f40e-4e3a-b11b-bfe75fafde78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:21.142631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b3aac-f40e-4e3a-b11b-bfe75fafde78 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:21.243832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 557/1115] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:20 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:21.249778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ba424-9571-42b1-84ba-2d0ccc24fca1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:21.309320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:21.348961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ba424-9571-42b1-84ba-2d0ccc24fca1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:21.383258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc6465-8d78-413b-8be4-a41291588676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:21.390377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6465-8d78-413b-8be4-a41291588676 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:21.390377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6465-8d78-413b-8be4-a41291588676 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:21.390377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6465-8d78-413b-8be4-a41291588676 None admin] PATH_INFO: `/v3/projects/4af1bf290524445687476694994d9b85` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:21.390377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc6465-8d78-413b-8be4-a41291588676 None admin] RBAC: Authorizing `identity:get_project(project_id=4af1bf290524445687476694994d9b85)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:21.390377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc6465-8d78-413b-8be4-a41291588676 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:21.390377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 559/1116] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:21 2022] GET /identity/v3/projects/4af1bf290524445687476694994d9b85 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:21.395378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b3aac-f40e-4e3a-b11b-bfe75fafde78 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:21.453927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:21.494678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b3aac-f40e-4e3a-b11b-bfe75fafde78 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:21.529643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa0a46-bea5-4da9-a90b-8676c2ca880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:21.530298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0a46-bea5-4da9-a90b-8676c2ca880e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:21.530538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0a46-bea5-4da9-a90b-8676c2ca880e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:21.530802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0a46-bea5-4da9-a90b-8676c2ca880e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:21.531613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa0a46-bea5-4da9-a90b-8676c2ca880e None admin] RBAC: Adding query filter params (role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=4af1bf290524445687476694994d9b85, user.id=7f5afe81e972480c9f63ce700987e377) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:21.531913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa0a46-bea5-4da9-a90b-8676c2ca880e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:21.533413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa0a46-bea5-4da9-a90b-8676c2ca880e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:21.538741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 558/1117] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:21 2022] GET /identity/v3/role_assignments?user.id=7f5afe81e972480c9f63ce700987e377&scope.project.id=4af1bf290524445687476694994d9b85&role.id=6b666ed01b97482497ff1f656ecff898 => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:23.725000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0632d-0dfb-4e43-9b8a-2730ccebedea None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:23.725597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0632d-0dfb-4e43-9b8a-2730ccebedea None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:23.725597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0632d-0dfb-4e43-9b8a-2730ccebedea None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:23.726817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 560/1118] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:23.732174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338967-6b05-4473-99e6-10b75e4ee236 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:23.732645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338967-6b05-4473-99e6-10b75e4ee236 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:23.732746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338967-6b05-4473-99e6-10b75e4ee236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:23.749147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e5338967-6b05-4473-99e6-10b75e4ee236 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:23.750316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e5338967-6b05-4473-99e6-10b75e4ee236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:23.814766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 559/1119] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:23 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:23.838760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0632d-0dfb-4e43-9b8a-2730ccebedea None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:23.937658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0632d-0dfb-4e43-9b8a-2730ccebedea None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:23.964924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:23.972251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ca5d-5ec5-4a57-b4b3-c3a7e22dae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:23.973113 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ca5d-5ec5-4a57-b4b3-c3a7e22dae7e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:23.973393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ca5d-5ec5-4a57-b4b3-c3a7e22dae7e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:23.973662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ca5d-5ec5-4a57-b4b3-c3a7e22dae7e None admin] PATH_INFO: `/v3/roles/6b666ed01b97482497ff1f656ecff898` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:23.975173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62ca5d-5ec5-4a57-b4b3-c3a7e22dae7e None admin] RBAC: Authorizing `identity:get_role(role_id=6b666ed01b97482497ff1f656ecff898)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:23.976517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62ca5d-5ec5-4a57-b4b3-c3a7e22dae7e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:23.978325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 561/1120] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:23 2022] GET /identity/v3/roles/6b666ed01b97482497ff1f656ecff898 => generated 224 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:23.984106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338967-6b05-4473-99e6-10b75e4ee236 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:24.037964 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:24.080985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338967-6b05-4473-99e6-10b75e4ee236 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:24.113782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a777a77-ae41-4022-959d-afa0de144dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:24.114636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777a77-ae41-4022-959d-afa0de144dde None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:24.114912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777a77-ae41-4022-959d-afa0de144dde None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:24.115183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777a77-ae41-4022-959d-afa0de144dde None admin] PATH_INFO: `/v3/users/7f5afe81e972480c9f63ce700987e377` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:24.116362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a777a77-ae41-4022-959d-afa0de144dde None admin] RBAC: Authorizing `identity:get_user(user_id=7f5afe81e972480c9f63ce700987e377)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:24.118315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a777a77-ae41-4022-959d-afa0de144dde None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:24.119921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 560/1121] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:23 2022] GET /identity/v3/users/7f5afe81e972480c9f63ce700987e377 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:24.125629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ca5d-5ec5-4a57-b4b3-c3a7e22dae7e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:24.222772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ca5d-5ec5-4a57-b4b3-c3a7e22dae7e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:24.255600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919e2c2-7d61-44f1-a231-cb492963e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:24.256465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919e2c2-7d61-44f1-a231-cb492963e856 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:24.256746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919e2c2-7d61-44f1-a231-cb492963e856 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:24.257023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919e2c2-7d61-44f1-a231-cb492963e856 None admin] PATH_INFO: `/v3/projects/4af1bf290524445687476694994d9b85` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:24.258191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919e2c2-7d61-44f1-a231-cb492963e856 None admin] RBAC: Authorizing `identity:get_project(project_id=4af1bf290524445687476694994d9b85)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:24.260236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919e2c2-7d61-44f1-a231-cb492963e856 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:24.262205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 562/1122] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:24 2022] GET /identity/v3/projects/4af1bf290524445687476694994d9b85 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:24.267979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a777a77-ae41-4022-959d-afa0de144dde None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:24.366422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a777a77-ae41-4022-959d-afa0de144dde None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:24.390207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:24.401372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c382e-3402-472b-a5ca-72142eb9632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:24.406312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c382e-3402-472b-a5ca-72142eb9632c None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:24.406312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c382e-3402-472b-a5ca-72142eb9632c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:24.406312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c382e-3402-472b-a5ca-72142eb9632c None admin] PATH_INFO: `/v3/projects/4af1bf290524445687476694994d9b85/users/7f5afe81e972480c9f63ce700987e377/roles/6b666ed01b97482497ff1f656ecff898` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:24.406312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c382e-3402-472b-a5ca-72142eb9632c None admin] RBAC: Authorizing `identity:create_grant(project_id=4af1bf290524445687476694994d9b85, user_id=7f5afe81e972480c9f63ce700987e377, role_id=6b666ed01b97482497ff1f656ecff898)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:24.406655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c382e-3402-472b-a5ca-72142eb9632c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:24.528295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 561/1123] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:53:24 2022] PUT /identity/v3/projects/4af1bf290524445687476694994d9b85/users/7f5afe81e972480c9f63ce700987e377/roles/6b666ed01b97482497ff1f656ecff898 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:53:26.690199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314e30-de83-4658-9578-4ae1c0d1b042 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:26.690726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314e30-de83-4658-9578-4ae1c0d1b042 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:26.690726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314e30-de83-4658-9578-4ae1c0d1b042 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:26.692014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 563/1124] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:26.697785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a9e73-1566-4ca7-9980-c01e9ea1b76f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:26.698485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a9e73-1566-4ca7-9980-c01e9ea1b76f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:26.698587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a9e73-1566-4ca7-9980-c01e9ea1b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:26.715303 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-188a9e73-1566-4ca7-9980-c01e9ea1b76f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:26.716509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-188a9e73-1566-4ca7-9980-c01e9ea1b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:26.781073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 562/1125] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:26 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:53:26.804293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26314e30-de83-4658-9578-4ae1c0d1b042 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:26.865353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:26.902861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26314e30-de83-4658-9578-4ae1c0d1b042 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:26.935066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aab5b-df8e-4999-a6c4-cf7a037f731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:26.935890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aab5b-df8e-4999-a6c4-cf7a037f731d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:26.936171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aab5b-df8e-4999-a6c4-cf7a037f731d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:26.936472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aab5b-df8e-4999-a6c4-cf7a037f731d None admin] PATH_INFO: `/v3/roles/6b666ed01b97482497ff1f656ecff898` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:26.937922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10aab5b-df8e-4999-a6c4-cf7a037f731d None admin] RBAC: Authorizing `identity:get_role(role_id=6b666ed01b97482497ff1f656ecff898)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:26.939291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10aab5b-df8e-4999-a6c4-cf7a037f731d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:26.940753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 564/1126] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:26 2022] GET /identity/v3/roles/6b666ed01b97482497ff1f656ecff898 => generated 224 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:26.947311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a9e73-1566-4ca7-9980-c01e9ea1b76f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:27.044572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a9e73-1566-4ca7-9980-c01e9ea1b76f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:27.056864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:27.077471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d5efc-5737-4acb-8792-79d084524ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:27.078337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d5efc-5737-4acb-8792-79d084524ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:27.078618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d5efc-5737-4acb-8792-79d084524ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:27.078892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d5efc-5737-4acb-8792-79d084524ba2 None admin] PATH_INFO: `/v3/users/7f5afe81e972480c9f63ce700987e377` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:27.080058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d5efc-5737-4acb-8792-79d084524ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5afe81e972480c9f63ce700987e377)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:27.081528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d5efc-5737-4acb-8792-79d084524ba2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:27.083146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 563/1127] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:26 2022] GET /identity/v3/users/7f5afe81e972480c9f63ce700987e377 => generated 287 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:27.089745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aab5b-df8e-4999-a6c4-cf7a037f731d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:27.186329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aab5b-df8e-4999-a6c4-cf7a037f731d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:27.215070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:27.219689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d7020-d260-4b88-be35-70b30568349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:27.220350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d7020-d260-4b88-be35-70b30568349d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:27.220633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d7020-d260-4b88-be35-70b30568349d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:27.220906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d7020-d260-4b88-be35-70b30568349d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:27.286225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d7020-d260-4b88-be35-70b30568349d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:27.287682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d7020-d260-4b88-be35-70b30568349d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:27.383282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 565/1128] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:27 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:27.390040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d5efc-5737-4acb-8792-79d084524ba2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:27.496650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d5efc-5737-4acb-8792-79d084524ba2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:27.530675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873d0e6-1113-4660-9375-7e5f3176d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:27.531540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873d0e6-1113-4660-9375-7e5f3176d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:27.531822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873d0e6-1113-4660-9375-7e5f3176d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:27.532095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873d0e6-1113-4660-9375-7e5f3176d2a2 None admin] PATH_INFO: `/v3/projects/4af1bf290524445687476694994d9b85` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:27.533308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873d0e6-1113-4660-9375-7e5f3176d2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=4af1bf290524445687476694994d9b85)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:27.534745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873d0e6-1113-4660-9375-7e5f3176d2a2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:27.536470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 564/1129] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:27 2022] GET /identity/v3/projects/4af1bf290524445687476694994d9b85 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:27.543087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d7020-d260-4b88-be35-70b30568349d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:27.574228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:27.649514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d7020-d260-4b88-be35-70b30568349d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:27.683768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a90da6-9654-4a36-ab17-1f078df7bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:27.684449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a90da6-9654-4a36-ab17-1f078df7bba6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:27.684734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a90da6-9654-4a36-ab17-1f078df7bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:27.685009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a90da6-9654-4a36-ab17-1f078df7bba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:27.685828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a90da6-9654-4a36-ab17-1f078df7bba6 None admin] RBAC: Adding query filter params (role.id=6b666ed01b97482497ff1f656ecff898, scope.project.id=4af1bf290524445687476694994d9b85, user.id=7f5afe81e972480c9f63ce700987e377) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:27.686136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a90da6-9654-4a36-ab17-1f078df7bba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:27.687573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a90da6-9654-4a36-ab17-1f078df7bba6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:27.693372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 566/1130] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:27 2022] GET /identity/v3/role_assignments?user.id=7f5afe81e972480c9f63ce700987e377&scope.project.id=4af1bf290524445687476694994d9b85&role.id=6b666ed01b97482497ff1f656ecff898 => generated 610 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:29.943934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41ed23-23b5-4f97-92fc-26337cc09d7e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:29.944522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41ed23-23b5-4f97-92fc-26337cc09d7e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:29.944710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41ed23-23b5-4f97-92fc-26337cc09d7e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:29.947210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 565/1131] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:29.952964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e828d0-33cd-4086-bb15-8d28a4b8e9c0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:29.953397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e828d0-33cd-4086-bb15-8d28a4b8e9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:29.953506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e828d0-33cd-4086-bb15-8d28a4b8e9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:29.970833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b3e828d0-33cd-4086-bb15-8d28a4b8e9c0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:29.972005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b3e828d0-33cd-4086-bb15-8d28a4b8e9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:30.038044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 567/1132] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:29 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:30.062338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41ed23-23b5-4f97-92fc-26337cc09d7e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:30.114322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:30.166751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41ed23-23b5-4f97-92fc-26337cc09d7e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:30.199077 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d0780-f68f-4385-b8c3-92bbbcc5528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:30.199791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0780-f68f-4385-b8c3-92bbbcc5528f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:30.200069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0780-f68f-4385-b8c3-92bbbcc5528f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:30.200362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d0780-f68f-4385-b8c3-92bbbcc5528f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:30.201511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d0780-f68f-4385-b8c3-92bbbcc5528f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:30.202909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d0780-f68f-4385-b8c3-92bbbcc5528f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:30.204637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 566/1133] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:30 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:30.210476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e828d0-33cd-4086-bb15-8d28a4b8e9c0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:30.237483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:30.308997 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e828d0-33cd-4086-bb15-8d28a4b8e9c0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:30.342138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1b678-28b2-4743-8064-e022b296f53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:30.342886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b678-28b2-4743-8064-e022b296f53f None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:30.343066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b678-28b2-4743-8064-e022b296f53f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:30.343511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b678-28b2-4743-8064-e022b296f53f None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:30.344037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1b678-28b2-4743-8064-e022b296f53f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:30.345501 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1b678-28b2-4743-8064-e022b296f53f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:30.489015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 568/1134] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:53:30 2022] POST /identity/v3/projects => generated 312 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:53:32.806612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd574d00-4e4f-4ce1-a43a-d787c3eb5dec None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:32.807164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd574d00-4e4f-4ce1-a43a-d787c3eb5dec None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:32.807164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd574d00-4e4f-4ce1-a43a-d787c3eb5dec None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:32.808518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 567/1135] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:32.813838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bb8c-99ad-49a3-8bd0-29b37eec45c5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:32.814287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bb8c-99ad-49a3-8bd0-29b37eec45c5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:32.814383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bb8c-99ad-49a3-8bd0-29b37eec45c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:32.830670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e598bb8c-99ad-49a3-8bd0-29b37eec45c5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:32.831840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e598bb8c-99ad-49a3-8bd0-29b37eec45c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:32.896538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 569/1136] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:32 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:32.922018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd574d00-4e4f-4ce1-a43a-d787c3eb5dec None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:33.023843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd574d00-4e4f-4ce1-a43a-d787c3eb5dec None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:33.048024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:33.068704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c6e59-69f6-4b9d-87a6-bf5dfaa76ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:33.069426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c6e59-69f6-4b9d-87a6-bf5dfaa76ace None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:33.069705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c6e59-69f6-4b9d-87a6-bf5dfaa76ace None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:33.069975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c6e59-69f6-4b9d-87a6-bf5dfaa76ace None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:33.071130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c6e59-69f6-4b9d-87a6-bf5dfaa76ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:33.072941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c6e59-69f6-4b9d-87a6-bf5dfaa76ace None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:33.074550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 568/1137] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:53:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:33.080369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598bb8c-99ad-49a3-8bd0-29b37eec45c5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:33.091305 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:33.175486 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598bb8c-99ad-49a3-8bd0-29b37eec45c5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:33.208546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af883-cac2-4ff3-9c00-acfb0a37a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:33.209197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af883-cac2-4ff3-9c00-acfb0a37a2c3 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:33.209475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af883-cac2-4ff3-9c00-acfb0a37a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:33.209746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af883-cac2-4ff3-9c00-acfb0a37a2c3 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:33.210451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af883-cac2-4ff3-9c00-acfb0a37a2c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:33.212426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af883-cac2-4ff3-9c00-acfb0a37a2c3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:33.329401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 570/1138] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:53:33 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:53:35.566721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596007fa-59ce-4058-a940-ea0b63d8100a None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:35.567240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596007fa-59ce-4058-a940-ea0b63d8100a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:35.567240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596007fa-59ce-4058-a940-ea0b63d8100a None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:35.568569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 569/1139] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:35.574512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994b86-38e2-4627-930a-57166fda16c2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:35.574940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994b86-38e2-4627-930a-57166fda16c2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:35.575067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994b86-38e2-4627-930a-57166fda16c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:35.591432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4e994b86-38e2-4627-930a-57166fda16c2 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:35.592656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4e994b86-38e2-4627-930a-57166fda16c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:35.649970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:35.657965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 571/1140] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:35 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:35.681982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596007fa-59ce-4058-a940-ea0b63d8100a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:35.783069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596007fa-59ce-4058-a940-ea0b63d8100a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:35.816890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b00e3-efb4-4aff-8003-f58aa9d42ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:35.817609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b00e3-efb4-4aff-8003-f58aa9d42ffb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:35.817894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b00e3-efb4-4aff-8003-f58aa9d42ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:35.818171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b00e3-efb4-4aff-8003-f58aa9d42ffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:35.829627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b00e3-efb4-4aff-8003-f58aa9d42ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-386b00e3-efb4-4aff-8003-f58aa9d42ffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:35.837299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:35.838552 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:35.839609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 570/1141] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:35.844718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e994b86-38e2-4627-930a-57166fda16c2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:35.940894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e994b86-38e2-4627-930a-57166fda16c2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:35.973858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:35.974505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:35.974779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:35.975046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:35.975779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:35.976081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:35.977487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:35.985882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 572/1142] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:53:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:35.991730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b00e3-efb4-4aff-8003-f58aa9d42ffb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:36.044377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:36.097364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b00e3-efb4-4aff-8003-f58aa9d42ffb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:36.130952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109500eb-f522-4121-97ce-ba89330b9f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:36.131816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109500eb-f522-4121-97ce-ba89330b9f92 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:36.132099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109500eb-f522-4121-97ce-ba89330b9f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:36.132402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109500eb-f522-4121-97ce-ba89330b9f92 None admin] PATH_INFO: `/v3/users/c92386c0684c4a88a9fceda6045d49a6` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:36.145623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109500eb-f522-4121-97ce-ba89330b9f92 None admin] RBAC: Authorizing `identity:get_user(user_id=c92386c0684c4a88a9fceda6045d49a6)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:36.148362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109500eb-f522-4121-97ce-ba89330b9f92 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:36.148736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 571/1143] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:35 2022] GET /identity/v3/users/c92386c0684c4a88a9fceda6045d49a6 => generated 287 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:36.155040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:36.210740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:36.295148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa6b2-4bb6-4afc-b889-54c2db287593 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:36.335763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77a9c-933d-4444-a0d9-f201cb88b493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:36.336895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77a9c-933d-4444-a0d9-f201cb88b493 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:36.337906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77a9c-933d-4444-a0d9-f201cb88b493 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:36.338381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77a9c-933d-4444-a0d9-f201cb88b493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:36.410686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77a9c-933d-4444-a0d9-f201cb88b493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:36.412065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77a9c-933d-4444-a0d9-f201cb88b493 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:36.466317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:36.508374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 573/1144] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:36 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:36.515321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109500eb-f522-4121-97ce-ba89330b9f92 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:36.612215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109500eb-f522-4121-97ce-ba89330b9f92 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:36.613754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:36.646195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02a9f8-0196-4331-a0dc-ab89f681898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:36.647033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02a9f8-0196-4331-a0dc-ab89f681898b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:36.647313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02a9f8-0196-4331-a0dc-ab89f681898b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:36.647587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02a9f8-0196-4331-a0dc-ab89f681898b None admin] PATH_INFO: `/v3/projects/69dda70454914e0fb537b9884b81b92c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:36.648773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02a9f8-0196-4331-a0dc-ab89f681898b None admin] RBAC: Authorizing `identity:get_project(project_id=69dda70454914e0fb537b9884b81b92c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:36.650303 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02a9f8-0196-4331-a0dc-ab89f681898b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:36.651968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 572/1145] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:36 2022] GET /identity/v3/projects/69dda70454914e0fb537b9884b81b92c => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:36.658025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77a9c-933d-4444-a0d9-f201cb88b493 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:36.756622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77a9c-933d-4444-a0d9-f201cb88b493 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:36.788709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b5e4-428f-471e-9864-8644c82865f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:36.789340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b5e4-428f-471e-9864-8644c82865f6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:36.789616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b5e4-428f-471e-9864-8644c82865f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:36.789887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b5e4-428f-471e-9864-8644c82865f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:36.791216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b5e4-428f-471e-9864-8644c82865f6 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=69dda70454914e0fb537b9884b81b92c, user.id=c92386c0684c4a88a9fceda6045d49a6) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:36.791514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b5e4-428f-471e-9864-8644c82865f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:36.792973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b5e4-428f-471e-9864-8644c82865f6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:36.798281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 574/1146] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:36 2022] GET /identity/v3/role_assignments?user.id=c92386c0684c4a88a9fceda6045d49a6&scope.project.id=69dda70454914e0fb537b9884b81b92c&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 260 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:38.992945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910dcb4-838c-485d-a856-fac8ccfd6347 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:38.993510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910dcb4-838c-485d-a856-fac8ccfd6347 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:38.993510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910dcb4-838c-485d-a856-fac8ccfd6347 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:38.995010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 573/1147] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:39.000198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003551ac-8946-4127-94bd-70553fc7f759 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:39.000644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003551ac-8946-4127-94bd-70553fc7f759 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:39.000774 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003551ac-8946-4127-94bd-70553fc7f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:39.018217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-003551ac-8946-4127-94bd-70553fc7f759 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:39.019397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-003551ac-8946-4127-94bd-70553fc7f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:39.034553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:39.086086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 575/1148] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:39.109043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910dcb4-838c-485d-a856-fac8ccfd6347 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:39.209015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910dcb4-838c-485d-a856-fac8ccfd6347 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:39.241271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a6a62-43d9-43ca-bab3-5bc013d73f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:39.242036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6a62-43d9-43ca-bab3-5bc013d73f9d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:39.242313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6a62-43d9-43ca-bab3-5bc013d73f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:39.242580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6a62-43d9-43ca-bab3-5bc013d73f9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:39.252948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a6a62-43d9-43ca-bab3-5bc013d73f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ae9a6a62-43d9-43ca-bab3-5bc013d73f9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:39.261037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:39.262134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 574/1149] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:39.268470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003551ac-8946-4127-94bd-70553fc7f759 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:39.363662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003551ac-8946-4127-94bd-70553fc7f759 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:39.398079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:39.398724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:39.399010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:39.399279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:39.400047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:39.400377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:39.401755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:39.409608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 576/1150] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:53:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:39.415782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a6a62-43d9-43ca-bab3-5bc013d73f9d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:39.448998 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:39.518225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a6a62-43d9-43ca-bab3-5bc013d73f9d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:39.550618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20c271-5df5-4ef6-8623-cb14431d561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:39.551470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c271-5df5-4ef6-8623-cb14431d561b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:39.551745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c271-5df5-4ef6-8623-cb14431d561b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:39.552014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c271-5df5-4ef6-8623-cb14431d561b None admin] PATH_INFO: `/v3/users/c92386c0684c4a88a9fceda6045d49a6` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:39.553246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20c271-5df5-4ef6-8623-cb14431d561b None admin] RBAC: Authorizing `identity:get_user(user_id=c92386c0684c4a88a9fceda6045d49a6)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:39.554656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20c271-5df5-4ef6-8623-cb14431d561b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:39.556869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 575/1151] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:39 2022] GET /identity/v3/users/c92386c0684c4a88a9fceda6045d49a6 => generated 287 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:39.562661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:39.577644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:39.659442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3827fb-6574-4c11-86ba-2b5b600b50f5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:39.691777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26699d9c-c231-46f1-a624-6948cf724fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:39.692625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699d9c-c231-46f1-a624-6948cf724fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:39.692895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699d9c-c231-46f1-a624-6948cf724fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:39.693161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26699d9c-c231-46f1-a624-6948cf724fa0 None admin] PATH_INFO: `/v3/projects/69dda70454914e0fb537b9884b81b92c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:39.694297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26699d9c-c231-46f1-a624-6948cf724fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=69dda70454914e0fb537b9884b81b92c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:39.695720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26699d9c-c231-46f1-a624-6948cf724fa0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:39.697500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 577/1152] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:39 2022] GET /identity/v3/projects/69dda70454914e0fb537b9884b81b92c => generated 312 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:39.703961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20c271-5df5-4ef6-8623-cb14431d561b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:39.800246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:39.804171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20c271-5df5-4ef6-8623-cb14431d561b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:39.839490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb8c13-e09e-4695-a5da-3ccdf577bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:39.840414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8c13-e09e-4695-a5da-3ccdf577bf01 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:39.840698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8c13-e09e-4695-a5da-3ccdf577bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:39.840971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8c13-e09e-4695-a5da-3ccdf577bf01 None admin] PATH_INFO: `/v3/projects/69dda70454914e0fb537b9884b81b92c/users/c92386c0684c4a88a9fceda6045d49a6/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:39.842931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb8c13-e09e-4695-a5da-3ccdf577bf01 None admin] RBAC: Authorizing `identity:create_grant(project_id=69dda70454914e0fb537b9884b81b92c, user_id=c92386c0684c4a88a9fceda6045d49a6, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:39.844464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb8c13-e09e-4695-a5da-3ccdf577bf01 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:39.913198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 576/1153] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:53:39 2022] PUT /identity/v3/projects/69dda70454914e0fb537b9884b81b92c/users/c92386c0684c4a88a9fceda6045d49a6/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:53:42.112649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ccb5a-4aa7-475b-b9c3-09df51f97311 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.113208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ccb5a-4aa7-475b-b9c3-09df51f97311 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.113208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ccb5a-4aa7-475b-b9c3-09df51f97311 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.114562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 578/1154] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:42.119943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30432-001f-405d-8ced-f8036aa9d269 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.120390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30432-001f-405d-8ced-f8036aa9d269 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.120542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30432-001f-405d-8ced-f8036aa9d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.138425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a3a30432-001f-405d-8ced-f8036aa9d269 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:42.139968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a3a30432-001f-405d-8ced-f8036aa9d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:42.204489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 577/1155] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:42 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:42.227834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ccb5a-4aa7-475b-b9c3-09df51f97311 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:42.308634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:42.327586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ccb5a-4aa7-475b-b9c3-09df51f97311 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:42.360889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3943-2f32-4286-b0ee-56d4ae09a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:42.361657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3943-2f32-4286-b0ee-56d4ae09a23a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.361939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3943-2f32-4286-b0ee-56d4ae09a23a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.362214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e3943-2f32-4286-b0ee-56d4ae09a23a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.371963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e3943-2f32-4286-b0ee-56d4ae09a23a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-341e3943-2f32-4286-b0ee-56d4ae09a23a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:42.379564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:42.380659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:42.381849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 579/1156] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:42.386840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a30432-001f-405d-8ced-f8036aa9d269 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:42.486769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:42.498760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a30432-001f-405d-8ced-f8036aa9d269 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:42.533209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:42.533860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.534190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.534462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.535194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:42.535498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:42.536878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:42.545521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 578/1157] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:53:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:42.550968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3943-2f32-4286-b0ee-56d4ae09a23a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:42.651289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e3943-2f32-4286-b0ee-56d4ae09a23a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:42.683882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879874-0834-4fd5-b16d-a7993a6127cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:42.684759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879874-0834-4fd5-b16d-a7993a6127cd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.685039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879874-0834-4fd5-b16d-a7993a6127cd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.685310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879874-0834-4fd5-b16d-a7993a6127cd None admin] PATH_INFO: `/v3/users/c92386c0684c4a88a9fceda6045d49a6` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.686465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879874-0834-4fd5-b16d-a7993a6127cd None admin] RBAC: Authorizing `identity:get_user(user_id=c92386c0684c4a88a9fceda6045d49a6)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:42.687890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879874-0834-4fd5-b16d-a7993a6127cd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:42.689513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 580/1158] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:42 2022] GET /identity/v3/users/c92386c0684c4a88a9fceda6045d49a6 => generated 287 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:42.695175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:42.793082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb25f9-59b3-431f-b3b6-fc5092cd509e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:42.824996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe40f-e572-4c9f-bc08-b92abb5a1413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:42.825621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe40f-e572-4c9f-bc08-b92abb5a1413 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:42.825897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe40f-e572-4c9f-bc08-b92abb5a1413 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:42.826164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe40f-e572-4c9f-bc08-b92abb5a1413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:42.844023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:42.891581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe40f-e572-4c9f-bc08-b92abb5a1413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:42.893185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe40f-e572-4c9f-bc08-b92abb5a1413 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:42.986531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 579/1159] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:42 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:42.992322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879874-0834-4fd5-b16d-a7993a6127cd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:43.003807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:43.090144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879874-0834-4fd5-b16d-a7993a6127cd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:43.122605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d692f2b-7588-4717-a418-ef7ab386bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:43.123446 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692f2b-7588-4717-a418-ef7ab386bcdb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:43.123729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692f2b-7588-4717-a418-ef7ab386bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:43.124004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692f2b-7588-4717-a418-ef7ab386bcdb None admin] PATH_INFO: `/v3/projects/69dda70454914e0fb537b9884b81b92c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:43.125193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d692f2b-7588-4717-a418-ef7ab386bcdb None admin] RBAC: Authorizing `identity:get_project(project_id=69dda70454914e0fb537b9884b81b92c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:43.126623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d692f2b-7588-4717-a418-ef7ab386bcdb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:43.128297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 581/1160] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:42 2022] GET /identity/v3/projects/69dda70454914e0fb537b9884b81b92c => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:43.135133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe40f-e572-4c9f-bc08-b92abb5a1413 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:43.182521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:43.231731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe40f-e572-4c9f-bc08-b92abb5a1413 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:43.265260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8cfbb-6e9c-4686-8ba3-c9b3a2f7812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:43.265894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8cfbb-6e9c-4686-8ba3-c9b3a2f7812f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:43.266173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8cfbb-6e9c-4686-8ba3-c9b3a2f7812f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:43.266445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8cfbb-6e9c-4686-8ba3-c9b3a2f7812f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:43.267253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8cfbb-6e9c-4686-8ba3-c9b3a2f7812f None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=69dda70454914e0fb537b9884b81b92c, user.id=c92386c0684c4a88a9fceda6045d49a6) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:43.267560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8cfbb-6e9c-4686-8ba3-c9b3a2f7812f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:43.269015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8cfbb-6e9c-4686-8ba3-c9b3a2f7812f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:43.274726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 580/1161] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:43 2022] GET /identity/v3/role_assignments?user.id=c92386c0684c4a88a9fceda6045d49a6&scope.project.id=69dda70454914e0fb537b9884b81b92c&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:45.469688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe18059-1920-420f-a4ec-65171ce67b0c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.470208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe18059-1920-420f-a4ec-65171ce67b0c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.470208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe18059-1920-420f-a4ec-65171ce67b0c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.471586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 582/1162] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:45.476710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a9ba6-113b-4eb1-8cbe-f918e68414cb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.477135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a9ba6-113b-4eb1-8cbe-f918e68414cb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.477262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a9ba6-113b-4eb1-8cbe-f918e68414cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.495192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0c3a9ba6-113b-4eb1-8cbe-f918e68414cb None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:45.496504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0c3a9ba6-113b-4eb1-8cbe-f918e68414cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:45.561266 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 581/1163] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:45 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:45.583041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe18059-1920-420f-a4ec-65171ce67b0c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:45.658768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:45.682112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe18059-1920-420f-a4ec-65171ce67b0c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:45.713830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109070c3-8cc7-4ec3-afa7-97b1ac6df00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:45.714450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109070c3-8cc7-4ec3-afa7-97b1ac6df00c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:45.714728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109070c3-8cc7-4ec3-afa7-97b1ac6df00c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:45.714998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109070c3-8cc7-4ec3-afa7-97b1ac6df00c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:45.781037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109070c3-8cc7-4ec3-afa7-97b1ac6df00c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:45.782488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109070c3-8cc7-4ec3-afa7-97b1ac6df00c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:45.854539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:45.876373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 583/1164] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:45 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:45.882366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a9ba6-113b-4eb1-8cbe-f918e68414cb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:45.926611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:45.979103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a9ba6-113b-4eb1-8cbe-f918e68414cb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:46.011014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bbe03-c860-4e24-ae9e-ce407e247b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:46.011788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bbe03-c860-4e24-ae9e-ce407e247b28 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:46.012066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bbe03-c860-4e24-ae9e-ce407e247b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:46.012356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bbe03-c860-4e24-ae9e-ce407e247b28 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:46.019065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bbe03-c860-4e24-ae9e-ce407e247b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:46.020512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bbe03-c860-4e24-ae9e-ce407e247b28 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a48bbe03-c860-4e24-ae9e-ce407e247b28 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:46.034748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:46.035963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:53:46.036957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 582/1165] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:53:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:46.041821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109070c3-8cc7-4ec3-afa7-97b1ac6df00c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:46.140101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109070c3-8cc7-4ec3-afa7-97b1ac6df00c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:46.173751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758fb3c-360f-4954-ad96-3ad579091392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:46.174393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758fb3c-360f-4954-ad96-3ad579091392 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:46.174671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758fb3c-360f-4954-ad96-3ad579091392 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:46.174942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758fb3c-360f-4954-ad96-3ad579091392 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:46.175649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758fb3c-360f-4954-ad96-3ad579091392 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:46.175951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758fb3c-360f-4954-ad96-3ad579091392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:46.177349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758fb3c-360f-4954-ad96-3ad579091392 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:46.184793 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 584/1166] 10.222.0.123 () {56 vars in 1120 bytes} [Thu May 26 17:53:46 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:53:48.451514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78edb5e-9d9e-46a1-b874-dbedc2c3ce1e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:48.452056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78edb5e-9d9e-46a1-b874-dbedc2c3ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:48.452056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78edb5e-9d9e-46a1-b874-dbedc2c3ce1e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:48.453469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 583/1167] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:48.458731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2dd9-711c-4e6b-91f1-87b4e395e19e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:48.459149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2dd9-711c-4e6b-91f1-87b4e395e19e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:48.459274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a2dd9-711c-4e6b-91f1-87b4e395e19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:48.476027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-366a2dd9-711c-4e6b-91f1-87b4e395e19e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:48.477225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-366a2dd9-711c-4e6b-91f1-87b4e395e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:48.511910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:48.544220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 585/1168] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:48 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:48.567364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78edb5e-9d9e-46a1-b874-dbedc2c3ce1e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:48.666545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78edb5e-9d9e-46a1-b874-dbedc2c3ce1e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:48.668774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:48.698929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd471e2d-cd10-4400-8647-33af6e30d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:48.699576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471e2d-cd10-4400-8647-33af6e30d321 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:48.699851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471e2d-cd10-4400-8647-33af6e30d321 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:48.700120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471e2d-cd10-4400-8647-33af6e30d321 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:48.700908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd471e2d-cd10-4400-8647-33af6e30d321 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:48.702816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd471e2d-cd10-4400-8647-33af6e30d321 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:48.771643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 584/1169] 10.222.0.123 () {60 vars in 1143 bytes} [Thu May 26 17:53:48 2022] POST /identity/v3/domains => generated 268 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:53:51.049034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd235-ce99-490f-9cf9-ca77de6000a1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:51.049570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd235-ce99-490f-9cf9-ca77de6000a1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:51.049570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd235-ce99-490f-9cf9-ca77de6000a1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:51.050932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 586/1170] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:51.056178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478219d9-8725-4880-8ad2-2957c6cc527b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:51.056606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478219d9-8725-4880-8ad2-2957c6cc527b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:51.056788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478219d9-8725-4880-8ad2-2957c6cc527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:51.073702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-478219d9-8725-4880-8ad2-2957c6cc527b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:51.074872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-478219d9-8725-4880-8ad2-2957c6cc527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:51.139951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 585/1171] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:51.163220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebd235-ce99-490f-9cf9-ca77de6000a1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:51.261921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebd235-ce99-490f-9cf9-ca77de6000a1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:51.294323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881021d5-157f-47b8-8285-5b5fccc8a0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:51.295165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881021d5-157f-47b8-8285-5b5fccc8a0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:51.295439 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881021d5-157f-47b8-8285-5b5fccc8a0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:51.295707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881021d5-157f-47b8-8285-5b5fccc8a0e9 None admin] PATH_INFO: `/v3/domains/5483132e44b24eef8408fef68bff8283` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:51.305993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881021d5-157f-47b8-8285-5b5fccc8a0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5483132e44b24eef8408fef68bff8283)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:51.308147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881021d5-157f-47b8-8285-5b5fccc8a0e9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:51.309819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 587/1172] 10.222.0.123 () {56 vars in 1188 bytes} [Thu May 26 17:53:51 2022] GET /identity/v3/domains/5483132e44b24eef8408fef68bff8283 => generated 268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:51.315644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478219d9-8725-4880-8ad2-2957c6cc527b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:51.403997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:51.410241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478219d9-8725-4880-8ad2-2957c6cc527b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:51.442572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14e972-e67b-4807-9a91-e492abe1c9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:51.443215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14e972-e67b-4807-9a91-e492abe1c9e4 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:51.443489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14e972-e67b-4807-9a91-e492abe1c9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:51.443822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14e972-e67b-4807-9a91-e492abe1c9e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:51.444803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14e972-e67b-4807-9a91-e492abe1c9e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:51.446454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14e972-e67b-4807-9a91-e492abe1c9e4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:51.525911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 586/1173] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:53:51 2022] POST /identity/v3/projects => generated 362 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:53:53.741591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0a32d-875b-4bd5-adaa-ec63c5000505 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:53.742128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0a32d-875b-4bd5-adaa-ec63c5000505 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:53.742128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0a32d-875b-4bd5-adaa-ec63c5000505 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:53.743490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 588/1174] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:53.748983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf936e-135d-4284-8abc-301a9dbc187f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:53.749385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf936e-135d-4284-8abc-301a9dbc187f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:53.749548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf936e-135d-4284-8abc-301a9dbc187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:53.767181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-efaf936e-135d-4284-8abc-301a9dbc187f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:53.768394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-efaf936e-135d-4284-8abc-301a9dbc187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:53.834505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 587/1175] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:53.860797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0a32d-875b-4bd5-adaa-ec63c5000505 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:53.891796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:53.961931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0a32d-875b-4bd5-adaa-ec63c5000505 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:53.994344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5c98b-af6b-4487-9a9e-9d083bb48128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:53.995189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5c98b-af6b-4487-9a9e-9d083bb48128 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:53.995525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5c98b-af6b-4487-9a9e-9d083bb48128 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:53.995798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5c98b-af6b-4487-9a9e-9d083bb48128 None admin] PATH_INFO: `/v3/domains/5483132e44b24eef8408fef68bff8283` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:53.997041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5c98b-af6b-4487-9a9e-9d083bb48128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5483132e44b24eef8408fef68bff8283)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:53.998464 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5c98b-af6b-4487-9a9e-9d083bb48128 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:54.000056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 589/1176] 10.222.0.123 () {56 vars in 1188 bytes} [Thu May 26 17:53:53 2022] GET /identity/v3/domains/5483132e44b24eef8408fef68bff8283 => generated 268 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:54.005764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf936e-135d-4284-8abc-301a9dbc187f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:54.085459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:54.109018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf936e-135d-4284-8abc-301a9dbc187f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:54.144929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c916d-e8d7-4a1f-8869-c20ca6198c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:54.145588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c916d-e8d7-4a1f-8869-c20ca6198c9d None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:54.145864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c916d-e8d7-4a1f-8869-c20ca6198c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:54.146134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c916d-e8d7-4a1f-8869-c20ca6198c9d None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:54.146841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c916d-e8d7-4a1f-8869-c20ca6198c9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:54.148279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c916d-e8d7-4a1f-8869-c20ca6198c9d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:54.227808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 588/1177] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:53:54 2022] POST /identity/v3/users => generated 312 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:53:56.462892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5d92a-3161-4f04-9671-31f02fc7c0b7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:56.463949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5d92a-3161-4f04-9671-31f02fc7c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:56.464079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5d92a-3161-4f04-9671-31f02fc7c0b7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:56.466005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 590/1178] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:56.471296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b560057-d48d-4595-ae74-2babc487c07f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:56.471715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b560057-d48d-4595-ae74-2babc487c07f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:56.471862 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b560057-d48d-4595-ae74-2babc487c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:56.488906 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9b560057-d48d-4595-ae74-2babc487c07f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:56.490096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9b560057-d48d-4595-ae74-2babc487c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:56.555020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 589/1179] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:56.578973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5d92a-3161-4f04-9671-31f02fc7c0b7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:56.675265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:56.679823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5d92a-3161-4f04-9671-31f02fc7c0b7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:56.712267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec08b8d-2232-4dfd-9e73-f6121f88be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:56.713271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec08b8d-2232-4dfd-9e73-f6121f88be7e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:56.714151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec08b8d-2232-4dfd-9e73-f6121f88be7e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:56.714737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec08b8d-2232-4dfd-9e73-f6121f88be7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:56.724360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec08b8d-2232-4dfd-9e73-f6121f88be7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-eec08b8d-2232-4dfd-9e73-f6121f88be7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:53:56.731794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:53:56.733023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:53:56.734217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 591/1180] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:53:56.738881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b560057-d48d-4595-ae74-2babc487c07f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:56.796931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:56.833205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b560057-d48d-4595-ae74-2babc487c07f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:56.865926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:56.866592 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:56.866882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:56.867363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:56.868258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:56.869040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:56.870425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:56.878146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 590/1181] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:53:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:56.883871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec08b8d-2232-4dfd-9e73-f6121f88be7e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:56.984001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec08b8d-2232-4dfd-9e73-f6121f88be7e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:57.017161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b25c-0d1e-462d-b0e9-6f44bd7c1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:57.018000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b25c-0d1e-462d-b0e9-6f44bd7c1e04 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:57.018278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b25c-0d1e-462d-b0e9-6f44bd7c1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:57.018549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b25c-0d1e-462d-b0e9-6f44bd7c1e04 None admin] PATH_INFO: `/v3/users/4314bdaae5bc414e9905332864d446ce` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:57.032498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80b25c-0d1e-462d-b0e9-6f44bd7c1e04 None admin] RBAC: Authorizing `identity:get_user(user_id=4314bdaae5bc414e9905332864d446ce)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:57.033966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80b25c-0d1e-462d-b0e9-6f44bd7c1e04 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:57.035624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 592/1182] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:53:56 2022] GET /identity/v3/users/4314bdaae5bc414e9905332864d446ce => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:57.041505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:57.139219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc47f-e425-4e9d-94ba-9fb972933501 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:57.161698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:57.172102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96bbe-9537-4985-b0b8-ad4ef2b778c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:57.174653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96bbe-9537-4985-b0b8-ad4ef2b778c5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:57.174653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96bbe-9537-4985-b0b8-ad4ef2b778c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:57.174653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96bbe-9537-4985-b0b8-ad4ef2b778c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:57.238285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96bbe-9537-4985-b0b8-ad4ef2b778c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:57.239721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96bbe-9537-4985-b0b8-ad4ef2b778c5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:57.336994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 591/1183] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:53:57 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:53:57.342919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b25c-0d1e-462d-b0e9-6f44bd7c1e04 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:57.360531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:57.439968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b25c-0d1e-462d-b0e9-6f44bd7c1e04 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:57.473290 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46c9a7-3d05-44bf-8047-81ac42c4b375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:57.474110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46c9a7-3d05-44bf-8047-81ac42c4b375 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:57.474394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46c9a7-3d05-44bf-8047-81ac42c4b375 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:57.474666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46c9a7-3d05-44bf-8047-81ac42c4b375 None admin] PATH_INFO: `/v3/projects/21a4a44cdd0749cf9e487cc1a9e90724` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:57.475827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46c9a7-3d05-44bf-8047-81ac42c4b375 None admin] RBAC: Authorizing `identity:get_project(project_id=21a4a44cdd0749cf9e487cc1a9e90724)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:57.477291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46c9a7-3d05-44bf-8047-81ac42c4b375 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:57.479500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 593/1184] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:53:57 2022] GET /identity/v3/projects/21a4a44cdd0749cf9e487cc1a9e90724 => generated 362 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:57.485719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96bbe-9537-4985-b0b8-ad4ef2b778c5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:57.509783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:57.584401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96bbe-9537-4985-b0b8-ad4ef2b778c5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:53:57.618733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc132c43-7f53-4a3d-ae2d-81741a8a00ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:53:57.619369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc132c43-7f53-4a3d-ae2d-81741a8a00ec None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:57.619698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc132c43-7f53-4a3d-ae2d-81741a8a00ec None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:57.620867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc132c43-7f53-4a3d-ae2d-81741a8a00ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:57.621710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc132c43-7f53-4a3d-ae2d-81741a8a00ec None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=21a4a44cdd0749cf9e487cc1a9e90724, user.id=4314bdaae5bc414e9905332864d446ce) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:53:57.622021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc132c43-7f53-4a3d-ae2d-81741a8a00ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:53:57.623437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc132c43-7f53-4a3d-ae2d-81741a8a00ec None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:53:57.628834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 592/1185] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:53:57 2022] GET /identity/v3/role_assignments?user.id=4314bdaae5bc414e9905332864d446ce&scope.project.id=21a4a44cdd0749cf9e487cc1a9e90724&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:53:59.793679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e9019-ec8e-4c4b-a3c7-0d93f6aec1e3 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:59.794224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e9019-ec8e-4c4b-a3c7-0d93f6aec1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:59.794224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e9019-ec8e-4c4b-a3c7-0d93f6aec1e3 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:59.795567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 594/1186] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:53:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:53:59.800851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ccd4e-a0fd-4860-90d4-48dbba9bdfbf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:53:59.801277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ccd4e-a0fd-4860-90d4-48dbba9bdfbf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:53:59.801393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ccd4e-a0fd-4860-90d4-48dbba9bdfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:53:59.818130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2b7ccd4e-a0fd-4860-90d4-48dbba9bdfbf None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:53:59.819309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2b7ccd4e-a0fd-4860-90d4-48dbba9bdfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:53:59.883867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 593/1187] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:53:59 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:53:59.907504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e9019-ec8e-4c4b-a3c7-0d93f6aec1e3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:53:59.992438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:00.009342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e9019-ec8e-4c4b-a3c7-0d93f6aec1e3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:00.051631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb372-8865-4c23-be2c-ee3595189a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:00.052351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb372-8865-4c23-be2c-ee3595189a74 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:00.052632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb372-8865-4c23-be2c-ee3595189a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:00.052903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb372-8865-4c23-be2c-ee3595189a74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:00.065582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb372-8865-4c23-be2c-ee3595189a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5decb372-8865-4c23-be2c-ee3595189a74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:54:00.073756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:54:00.074856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:54:00.075748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 595/1188] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:53:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:54:00.081068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ccd4e-a0fd-4860-90d4-48dbba9bdfbf None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:00.099677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:00.189471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ccd4e-a0fd-4860-90d4-48dbba9bdfbf None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:00.224688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:00.225341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:00.225622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:00.225894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:00.226625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:54:00.226930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:00.228319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:00.236367 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 594/1189] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:54:00 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:54:00.242256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb372-8865-4c23-be2c-ee3595189a74 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:00.342085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb372-8865-4c23-be2c-ee3595189a74 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:00.376414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577919-9abe-4fbc-b23e-d756af91e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:00.377334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577919-9abe-4fbc-b23e-d756af91e52c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:00.377643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577919-9abe-4fbc-b23e-d756af91e52c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:00.377915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577919-9abe-4fbc-b23e-d756af91e52c None admin] PATH_INFO: `/v3/users/4314bdaae5bc414e9905332864d446ce` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:00.379150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa577919-9abe-4fbc-b23e-d756af91e52c None admin] RBAC: Authorizing `identity:get_user(user_id=4314bdaae5bc414e9905332864d446ce)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:00.380606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa577919-9abe-4fbc-b23e-d756af91e52c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:00.382208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 596/1190] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:54:00 2022] GET /identity/v3/users/4314bdaae5bc414e9905332864d446ce => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:54:00.389049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:00.469309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:00.488831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fabf0e-b5e7-4817-b5e0-394ef5283a48 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:00.523166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494666-1cdf-4e55-b75c-30a830f1fcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:00.524016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494666-1cdf-4e55-b75c-30a830f1fcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:00.524296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494666-1cdf-4e55-b75c-30a830f1fcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:00.524599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494666-1cdf-4e55-b75c-30a830f1fcb5 None admin] PATH_INFO: `/v3/projects/21a4a44cdd0749cf9e487cc1a9e90724` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:00.525769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37494666-1cdf-4e55-b75c-30a830f1fcb5 None admin] RBAC: Authorizing `identity:get_project(project_id=21a4a44cdd0749cf9e487cc1a9e90724)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:00.527275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37494666-1cdf-4e55-b75c-30a830f1fcb5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:00.528991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 595/1191] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:54:00 2022] GET /identity/v3/projects/21a4a44cdd0749cf9e487cc1a9e90724 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:54:00.534896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577919-9abe-4fbc-b23e-d756af91e52c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:00.550509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:00.636613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577919-9abe-4fbc-b23e-d756af91e52c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:00.671180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db51448-aedb-4c56-bd18-dbe1ba553729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:00.672049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51448-aedb-4c56-bd18-dbe1ba553729 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:00.672350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51448-aedb-4c56-bd18-dbe1ba553729 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:00.672626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51448-aedb-4c56-bd18-dbe1ba553729 None admin] PATH_INFO: `/v3/projects/21a4a44cdd0749cf9e487cc1a9e90724/users/4314bdaae5bc414e9905332864d446ce/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:00.677268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db51448-aedb-4c56-bd18-dbe1ba553729 None admin] RBAC: Authorizing `identity:create_grant(project_id=21a4a44cdd0749cf9e487cc1a9e90724, user_id=4314bdaae5bc414e9905332864d446ce, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:00.678888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db51448-aedb-4c56-bd18-dbe1ba553729 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:00.766221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 597/1192] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:54:00 2022] PUT /identity/v3/projects/21a4a44cdd0749cf9e487cc1a9e90724/users/4314bdaae5bc414e9905332864d446ce/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:54:02.953971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424248c7-bf91-47f7-9796-47f1135d9822 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:02.954535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424248c7-bf91-47f7-9796-47f1135d9822 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:02.954535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424248c7-bf91-47f7-9796-47f1135d9822 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:02.955912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 596/1193] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:54:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:54:02.961344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefafc2a-5af4-4ff7-a9f4-ff5169bf2adc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:02.961786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefafc2a-5af4-4ff7-a9f4-ff5169bf2adc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:02.961895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefafc2a-5af4-4ff7-a9f4-ff5169bf2adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:02.978585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fefafc2a-5af4-4ff7-a9f4-ff5169bf2adc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:54:02.980559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fefafc2a-5af4-4ff7-a9f4-ff5169bf2adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:54:03.044004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 598/1194] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:54:02 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 17:54:03.068500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424248c7-bf91-47f7-9796-47f1135d9822 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:03.169840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424248c7-bf91-47f7-9796-47f1135d9822 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:03.202004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf76f3-2cf3-4445-b0d8-44e4ff31430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:03.202785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf76f3-2cf3-4445-b0d8-44e4ff31430d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:03.203062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf76f3-2cf3-4445-b0d8-44e4ff31430d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:03.203330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf76f3-2cf3-4445-b0d8-44e4ff31430d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:03.213520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf76f3-2cf3-4445-b0d8-44e4ff31430d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-28cf76f3-2cf3-4445-b0d8-44e4ff31430d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:54:03.221869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:54:03.222954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:54:03.223996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 597/1195] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:54:03.229090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefafc2a-5af4-4ff7-a9f4-ff5169bf2adc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:03.231374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:03.328227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefafc2a-5af4-4ff7-a9f4-ff5169bf2adc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:03.360593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:03.361241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:03.361516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:03.361784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:03.362512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:54:03.362812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:03.364168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:03.372601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 599/1196] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:54:03 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:54:03.378442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf76f3-2cf3-4445-b0d8-44e4ff31430d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:03.390030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:03.475695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf76f3-2cf3-4445-b0d8-44e4ff31430d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:03.508789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5034b-977a-489a-9f1f-c3d74be81c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:03.509700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5034b-977a-489a-9f1f-c3d74be81c69 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:03.509978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5034b-977a-489a-9f1f-c3d74be81c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:03.510317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5034b-977a-489a-9f1f-c3d74be81c69 None admin] PATH_INFO: `/v3/users/4314bdaae5bc414e9905332864d446ce` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:03.511618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5034b-977a-489a-9f1f-c3d74be81c69 None admin] RBAC: Authorizing `identity:get_user(user_id=4314bdaae5bc414e9905332864d446ce)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:03.513062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5034b-977a-489a-9f1f-c3d74be81c69 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:03.514652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 598/1197] 10.222.0.123 () {56 vars in 1182 bytes} [Thu May 26 17:54:03 2022] GET /identity/v3/users/4314bdaae5bc414e9905332864d446ce => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:54:03.520847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:03.586502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:03.624114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55d7f0-8a59-4656-a279-dcd83b6cac38 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:03.656928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e010-cdea-46b7-ac7f-10df66fed728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:03.657558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e010-cdea-46b7-ac7f-10df66fed728 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:03.657835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e010-cdea-46b7-ac7f-10df66fed728 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:03.658104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e010-cdea-46b7-ac7f-10df66fed728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:03.722240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e010-cdea-46b7-ac7f-10df66fed728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:03.723684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e010-cdea-46b7-ac7f-10df66fed728 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:03.781148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:03.818697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 600/1198] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:54:03 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:54:03.824642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5034b-977a-489a-9f1f-c3d74be81c69 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:03.913685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:03.941641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5034b-977a-489a-9f1f-c3d74be81c69 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:03.980816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffe9ac-5185-4e9d-bbaa-9f3789fd1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:03.981655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe9ac-5185-4e9d-bbaa-9f3789fd1397 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:03.981929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe9ac-5185-4e9d-bbaa-9f3789fd1397 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:03.982195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffe9ac-5185-4e9d-bbaa-9f3789fd1397 None admin] PATH_INFO: `/v3/projects/21a4a44cdd0749cf9e487cc1a9e90724` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:03.983342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffe9ac-5185-4e9d-bbaa-9f3789fd1397 None admin] RBAC: Authorizing `identity:get_project(project_id=21a4a44cdd0749cf9e487cc1a9e90724)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:03.984783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffe9ac-5185-4e9d-bbaa-9f3789fd1397 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:03.986453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 599/1199] 10.222.0.123 () {56 vars in 1191 bytes} [Thu May 26 17:54:03 2022] GET /identity/v3/projects/21a4a44cdd0749cf9e487cc1a9e90724 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:54:03.992586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e010-cdea-46b7-ac7f-10df66fed728 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:54:04.087041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e010-cdea-46b7-ac7f-10df66fed728 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:54:04.120732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f73f5-0fc5-4015-961d-3d85eff0b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:54:04.121368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f73f5-0fc5-4015-961d-3d85eff0b61d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:54:04.121648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f73f5-0fc5-4015-961d-3d85eff0b61d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:54:04.121923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f73f5-0fc5-4015-961d-3d85eff0b61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:54:04.122737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f73f5-0fc5-4015-961d-3d85eff0b61d None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=21a4a44cdd0749cf9e487cc1a9e90724, user.id=4314bdaae5bc414e9905332864d446ce) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:54:04.123044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f73f5-0fc5-4015-961d-3d85eff0b61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:54:04.124499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f73f5-0fc5-4015-961d-3d85eff0b61d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:54:04.130198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 601/1200] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:54:03 2022] GET /identity/v3/role_assignments?user.id=4314bdaae5bc414e9905332864d446ce&scope.project.id=21a4a44cdd0749cf9e487cc1a9e90724&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 610 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:54:13.976064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=28 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:14.127586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:28.782519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b59ab0-52c2-4c1d-8818-48a70561703c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:28.783117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b59ab0-52c2-4c1d-8818-48a70561703c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:28.783117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b59ab0-52c2-4c1d-8818-48a70561703c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:28.784453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 600/1201] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:55:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:55:28.790468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56917d1-e618-404f-8210-7e67cd5579cd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:28.790913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56917d1-e618-404f-8210-7e67cd5579cd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:28.791011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56917d1-e618-404f-8210-7e67cd5579cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:28.808860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d56917d1-e618-404f-8210-7e67cd5579cd None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:28.810030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d56917d1-e618-404f-8210-7e67cd5579cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:28.877701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 602/1202] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:55:28 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:55:28.903071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b59ab0-52c2-4c1d-8818-48a70561703c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:29.010932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b59ab0-52c2-4c1d-8818-48a70561703c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:29.049780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:29.049780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:29.049780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:29.049780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:29.057986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:29.059410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:29.077526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:29.078665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:29.079839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:29.079839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:29.079839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:29.079839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:29.079839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 601/1203] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:29.085509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56917d1-e618-404f-8210-7e67cd5579cd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:29.181023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56917d1-e618-404f-8210-7e67cd5579cd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:29.209511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:29.215132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547c1fb-b990-41ab-b7c7-58aa7de42d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:29.215780 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c1fb-b990-41ab-b7c7-58aa7de42d81 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:29.216062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c1fb-b990-41ab-b7c7-58aa7de42d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:29.216361 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c1fb-b990-41ab-b7c7-58aa7de42d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:29.217080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547c1fb-b990-41ab-b7c7-58aa7de42d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:29.217387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547c1fb-b990-41ab-b7c7-58aa7de42d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:29.218771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547c1fb-b990-41ab-b7c7-58aa7de42d81 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:29.229980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 603/1204] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:29.235678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:29.288274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:29.335301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37e035-9b42-475f-abfd-c32c76baa102 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:29.367799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a91c4-c952-4eca-aac4-5b7602c4b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:29.368481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a91c4-c952-4eca-aac4-5b7602c4b15b None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:29.368758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a91c4-c952-4eca-aac4-5b7602c4b15b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:29.369030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a91c4-c952-4eca-aac4-5b7602c4b15b None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:29.369726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a91c4-c952-4eca-aac4-5b7602c4b15b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:29.371140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a91c4-c952-4eca-aac4-5b7602c4b15b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:29.535211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 602/1205] 10.222.0.123 () {60 vars in 1137 bytes} [Thu May 26 17:55:29 2022] POST /identity/v3/users => generated 252 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:55:31.788077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6487dda-f5c8-4c23-9d70-12834551208e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:31.788691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6487dda-f5c8-4c23-9d70-12834551208e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:31.788691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6487dda-f5c8-4c23-9d70-12834551208e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:31.790055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 604/1206] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:55:31 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:55:31.795828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477dc87-e1e4-4f2f-a0db-a1d74800967f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:31.796639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477dc87-e1e4-4f2f-a0db-a1d74800967f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:31.796920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477dc87-e1e4-4f2f-a0db-a1d74800967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:31.814760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0477dc87-e1e4-4f2f-a0db-a1d74800967f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:31.816096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0477dc87-e1e4-4f2f-a0db-a1d74800967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:31.885586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 603/1207] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:55:31 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:55:31.909115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6487dda-f5c8-4c23-9d70-12834551208e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:32.009649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6487dda-f5c8-4c23-9d70-12834551208e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:32.042365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c379a-aedf-428c-adc0-bc08a98931ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:32.043075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c379a-aedf-428c-adc0-bc08a98931ae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:32.043355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c379a-aedf-428c-adc0-bc08a98931ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:32.043629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c379a-aedf-428c-adc0-bc08a98931ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:32.053939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c379a-aedf-428c-adc0-bc08a98931ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-005c379a-aedf-428c-adc0-bc08a98931ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:55:32.061577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:32.066545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:32.067565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 605/1208] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:55:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:32.069254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477dc87-e1e4-4f2f-a0db-a1d74800967f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:32.107959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:32.166351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477dc87-e1e4-4f2f-a0db-a1d74800967f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:32.199854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:32.200578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:32.200862 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:32.201133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:32.201864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:32.202170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:32.203556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:32.212112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 604/1209] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:55:32 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:32.217816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c379a-aedf-428c-adc0-bc08a98931ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:32.267947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:32.318572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c379a-aedf-428c-adc0-bc08a98931ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:32.351713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:32.352531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:32.352815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:32.353089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:32.362676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:32.364720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:32.382149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:32.383183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:32.384340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:32.384340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:32.384340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:32.384340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:32.384340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 606/1210] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:32.389365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:32.484511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:32.487386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef311-6cb9-47ec-b480-72f54daba000 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:32.520910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:32.521555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:32.521924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:32.522189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:32.522889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:32.523188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:32.524564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:32.535996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 605/1211] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:55:32.541647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:32.640687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbb12d-49cc-4211-8f70-7f77c00cee7b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:32.642117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:32.674249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:32.675055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:32.675931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:32.676239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:32.683368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:32.684870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:55:32.700937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:32.707851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:32.709088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 607/1212] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:32.709825 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:32.806503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e533c-665a-46a9-b729-d885585cd3a0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:32.841289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:32.842355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:32.842819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:32.843166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:32.843986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:32.844292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:32.845714 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:32.862508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 606/1213] 10.222.0.123 () {56 vars in 1148 bytes} [Thu May 26 17:55:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:32.868432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:32.968113 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12640d-8a41-48b6-842a-1e6edd38f2e3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:33.000958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6755f4-87a7-4373-bd66-462d6246eb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:33.001591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6755f4-87a7-4373-bd66-462d6246eb5d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.001869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6755f4-87a7-4373-bd66-462d6246eb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.002140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6755f4-87a7-4373-bd66-462d6246eb5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.038942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:33.076202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6755f4-87a7-4373-bd66-462d6246eb5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:33.077675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6755f4-87a7-4373-bd66-462d6246eb5d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:33.174085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 608/1214] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:55:32 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:55:33.180493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:33.199673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:33.277632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12fcdb-e3c2-453b-b9da-f74ec9807baa None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:33.311377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:33.316602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.316602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.316602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.323129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:33.324592 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:33.343746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:33.349027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:33.350205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:33.350205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:33.350205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:33.350205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:33.350205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 607/1215] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:33.351185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6755f4-87a7-4373-bd66-462d6246eb5d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:33.412717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:33.450399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6755f4-87a7-4373-bd66-462d6246eb5d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:33.483431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:33.484072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.484372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.484700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.485425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:33.485728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:33.487104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:33.498393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 609/1216] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:33.504265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:33.573165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:33.603842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38c7e0-b6cf-4974-a6fe-a8968ee5f749 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:33.637678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:33.638565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.638847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.639119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.645926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:33.647353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:55:33.661703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:33.662583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:33.663574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 608/1217] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:33.668803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:33.768497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bc469-7891-4b13-9789-f93c52242539 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:33.792242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:33.803956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9e61a-e33d-4968-8685-687d191c0533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:33.804642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9e61a-e33d-4968-8685-687d191c0533 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.804922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9e61a-e33d-4968-8685-687d191c0533 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.805195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9e61a-e33d-4968-8685-687d191c0533 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.805967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9e61a-e33d-4968-8685-687d191c0533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:33.806277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9e61a-e33d-4968-8685-687d191c0533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:33.807798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9e61a-e33d-4968-8685-687d191c0533 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:33.820037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 610/1218] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:33.829551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:33.936872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e07a-8ea5-46dd-aa48-7b88f91b78e8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:33.965192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:33.970859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eba16-afec-49d6-ba61-1ff95b8ae1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:33.971500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eba16-afec-49d6-ba61-1ff95b8ae1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:33.971774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eba16-afec-49d6-ba61-1ff95b8ae1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:33.972067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eba16-afec-49d6-ba61-1ff95b8ae1c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:33.973435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eba16-afec-49d6-ba61-1ff95b8ae1c3 None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=dfe692e2ebff459f89835258db961125) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:33.973897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eba16-afec-49d6-ba61-1ff95b8ae1c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:33.995891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eba16-afec-49d6-ba61-1ff95b8ae1c3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:33.995891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 609/1219] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:55:33 2022] GET /identity/v3/role_assignments?user.id=dfe692e2ebff459f89835258db961125&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:36.150561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b97f9-ad7b-421e-9582-5fc72d20503b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:36.151090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b97f9-ad7b-421e-9582-5fc72d20503b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:36.151090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b97f9-ad7b-421e-9582-5fc72d20503b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:36.152513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 611/1220] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:55:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:55:36.158075 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c129-e241-4d07-92d0-62d292b0c821 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:36.158490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c129-e241-4d07-92d0-62d292b0c821 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:36.158625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c129-e241-4d07-92d0-62d292b0c821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:36.176587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d880c129-e241-4d07-92d0-62d292b0c821 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:36.177766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d880c129-e241-4d07-92d0-62d292b0c821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:36.256099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 610/1221] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:55:36 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:55:36.278959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b97f9-ad7b-421e-9582-5fc72d20503b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:36.381272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b97f9-ad7b-421e-9582-5fc72d20503b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:36.415679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473275c-8857-470a-9a33-8b6641c96586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:36.416416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473275c-8857-470a-9a33-8b6641c96586 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:36.416692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473275c-8857-470a-9a33-8b6641c96586 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:36.416959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473275c-8857-470a-9a33-8b6641c96586 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:36.427254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473275c-8857-470a-9a33-8b6641c96586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4473275c-8857-470a-9a33-8b6641c96586 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:55:36.434827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:36.444364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:36.445427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 612/1222] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:55:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:36.446297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c129-e241-4d07-92d0-62d292b0c821 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:36.551350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c129-e241-4d07-92d0-62d292b0c821 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:36.574804 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:36.585319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:36.585975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:36.586250 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:36.586519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:36.587244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:36.587564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:36.588962 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:36.597520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 611/1223] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:55:36 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:36.603544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473275c-8857-470a-9a33-8b6641c96586 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:36.647042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:36.702920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473275c-8857-470a-9a33-8b6641c96586 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:36.736282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:36.737080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:36.737368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:36.738190 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:36.748453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:36.749922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:36.767022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:36.767937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:36.769454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:36.769454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:36.769454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:36.769454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:36.769454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 613/1224] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:36.774758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:36.877554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed63a5-be49-41d2-9be4-49dff6ac6ae9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:36.912036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:36.912722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:36.913004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:36.913279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:36.914037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:36.914344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:36.915883 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:36.927530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 612/1225] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:36.933203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:37.024812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:37.031286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c34d-ea23-412c-8c32-058fa0292bfe None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:37.063543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:37.064350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:37.064632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:37.064900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:37.072274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:37.073722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:55:37.088235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:37.089337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:37.090490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 614/1226] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:37.095332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:37.142074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:37.194551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c32afb-43d3-405d-953a-948f59ba6df6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:37.229556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:37.236330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:37.236330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:37.236330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:37.236330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:37.236330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:37.236330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:37.250128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 613/1227] 10.222.0.123 () {56 vars in 1148 bytes} [Thu May 26 17:55:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:37.256443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:37.354666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a088dd1-734a-4e3c-b2df-38976392dac7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:37.389219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:37.389987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:37.390264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:37.390530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:37.401510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:37.403080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:37.419652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:37.420730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:37.421958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:37.421958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:37.421958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:37.421958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:37.421958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 615/1228] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:37.426925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:37.530337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf3753-48e3-4959-8e51-460eea1cbd1e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:37.532746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:37.568215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:37.568215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:37.568215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:37.568215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:37.568688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:37.568688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:37.568857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:37.579813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 614/1229] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:37.585561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:37.594682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:37.681767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da3ce2-f5e8-49dd-a54b-55fd6c9929fe None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:37.714631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:37.715401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:37.715678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:37.715948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:37.722417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:37.724256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:55:37.740733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:37.741905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:37.742998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 616/1230] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:37.747824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:37.849236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf425560-0376-41be-8c86-55847268f6e2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:37.881611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af766b8-83ed-438e-b213-02635d33299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:37.882334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af766b8-83ed-438e-b213-02635d33299b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:37.882613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af766b8-83ed-438e-b213-02635d33299b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:37.882882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af766b8-83ed-438e-b213-02635d33299b None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:37.883641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af766b8-83ed-438e-b213-02635d33299b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:37.883944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af766b8-83ed-438e-b213-02635d33299b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:37.885654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af766b8-83ed-438e-b213-02635d33299b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:37.898262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 615/1231] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:37.904355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:37.973268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:38.006704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd143-a91a-425a-8355-7da41cf56d30 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:38.040440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98d3c2-d109-4d8d-841c-38858933ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:38.042585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d3c2-d109-4d8d-841c-38858933ed7b None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:38.042585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d3c2-d109-4d8d-841c-38858933ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:38.042585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d3c2-d109-4d8d-841c-38858933ed7b None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/dfe692e2ebff459f89835258db961125/roles/a9ef6ba6c6a94fc7bcb5d8b628725987` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:38.056616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98d3c2-d109-4d8d-841c-38858933ed7b None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=dfe692e2ebff459f89835258db961125, role_id=a9ef6ba6c6a94fc7bcb5d8b628725987)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:38.058060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98d3c2-d109-4d8d-841c-38858933ed7b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:38.158393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 617/1232] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:55:37 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/dfe692e2ebff459f89835258db961125/roles/a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:55:40.332273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ea74-fdb6-498a-8176-f4f82804bf97 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:40.332771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ea74-fdb6-498a-8176-f4f82804bf97 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:40.332879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ea74-fdb6-498a-8176-f4f82804bf97 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:40.334361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 616/1233] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:55:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:55:40.339978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513115c2-e730-4991-995f-00156a924a1d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:40.346390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513115c2-e730-4991-995f-00156a924a1d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:40.346390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513115c2-e730-4991-995f-00156a924a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:40.357163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-513115c2-e730-4991-995f-00156a924a1d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:40.358352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-513115c2-e730-4991-995f-00156a924a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:40.425372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 618/1234] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:55:40 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:55:40.449560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85ea74-fdb6-498a-8176-f4f82804bf97 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:40.480746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:40.561585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85ea74-fdb6-498a-8176-f4f82804bf97 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:40.595311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df0e68-dfe5-4399-a451-e820ba5b28f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:40.596085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df0e68-dfe5-4399-a451-e820ba5b28f8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:40.596465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df0e68-dfe5-4399-a451-e820ba5b28f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:40.597402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df0e68-dfe5-4399-a451-e820ba5b28f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:40.607314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df0e68-dfe5-4399-a451-e820ba5b28f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-84df0e68-dfe5-4399-a451-e820ba5b28f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:55:40.615196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:40.619146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:40.620179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 617/1235] 10.222.0.123 () {56 vars in 1107 bytes} [Thu May 26 17:55:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:40.622333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513115c2-e730-4991-995f-00156a924a1d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:40.669782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:40.722704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513115c2-e730-4991-995f-00156a924a1d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:40.754987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:40.755645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:40.755924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:40.756213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:40.756979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:40.757283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:40.758663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:40.767219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 619/1236] 10.222.0.123 () {56 vars in 1108 bytes} [Thu May 26 17:55:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:40.773849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df0e68-dfe5-4399-a451-e820ba5b28f8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:40.859560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:40.874378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df0e68-dfe5-4399-a451-e820ba5b28f8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:40.908079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:40.908891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:40.909774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:40.910058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:40.920283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:40.921759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:40.938435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:40.941258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:40.942521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:40.942521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:40.942521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:40.942521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:40.942521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 618/1237] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:40.946504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:41.044449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f372-69be-46d0-9495-4b01b829dd2d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:41.053765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:41.078374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:41.079053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:41.079335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:41.079609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:41.081681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:41.081681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:41.082819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:41.098824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 620/1238] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:41.104550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:41.209458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09c11-b970-4dae-a1a0-e3114c0a2408 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:41.242838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:41.243637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:41.243921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:41.244197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:41.246879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:41.251873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:41.254064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:55:41.268447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:41.269997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:41.271213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 619/1239] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:41.276179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:41.381041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3c85e-f203-45f1-8a65-e97b90bcd01b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:41.413591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:41.414249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:41.414527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:41.414796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:41.415614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:41.415918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:41.417376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:41.435539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 621/1240] 10.222.0.123 () {56 vars in 1148 bytes} [Thu May 26 17:55:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:41.442004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:41.549569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713da9-9c8e-40eb-b5df-d26c43ed499f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:41.583426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834c3b6-20b8-4d7b-ba41-a757ba4ff7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:41.597466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c3b6-20b8-4d7b-ba41-a757ba4ff7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:41.597466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c3b6-20b8-4d7b-ba41-a757ba4ff7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:41.597466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c3b6-20b8-4d7b-ba41-a757ba4ff7c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:41.644850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:41.651124 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834c3b6-20b8-4d7b-ba41-a757ba4ff7c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:41.652615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834c3b6-20b8-4d7b-ba41-a757ba4ff7c0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:41.747274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 620/1241] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:55:41 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:55:41.753357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:41.780541 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:41.853315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc47f0e-6145-47fd-8f8c-f31c5089ab45 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:41.886085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:41.886938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:41.887117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:41.887385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:41.897197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:41.898635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:41.916081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:41.917409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:41.918560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:41.918560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:41.918560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:41.918560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:41.918560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 622/1242] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:41.923141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834c3b6-20b8-4d7b-ba41-a757ba4ff7c0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:42.016935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:42.023376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834c3b6-20b8-4d7b-ba41-a757ba4ff7c0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:42.057485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:42.058135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:42.058410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:42.058679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:42.059379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:42.059679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:42.061141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:42.072890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 621/1243] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:42.078511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:42.155462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:42.176535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085da1b3-f04c-4c79-a550-18a258c86ce6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:42.208853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:42.209631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:42.209901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:42.210174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:42.216747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:42.218324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:55:42.232653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:42.233670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:42.234892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 623/1244] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:42.239724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:42.340746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c458-6798-4af9-9783-11870fba9941 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:42.373752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170e84e-cd0b-418e-a9cd-52e92d8b0f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:42.374389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170e84e-cd0b-418e-a9cd-52e92d8b0f91 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:42.374666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170e84e-cd0b-418e-a9cd-52e92d8b0f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:42.374935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170e84e-cd0b-418e-a9cd-52e92d8b0f91 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:42.375706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170e84e-cd0b-418e-a9cd-52e92d8b0f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:42.376009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170e84e-cd0b-418e-a9cd-52e92d8b0f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:42.377452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170e84e-cd0b-418e-a9cd-52e92d8b0f91 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:42.389519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 622/1245] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:42.396258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:42.493278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df3432-cb9a-4ac2-b0f0-ee3a26bf837c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:42.526434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc7d5a-d1dc-467f-a23c-a3f909efd7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:42.527067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7d5a-d1dc-467f-a23c-a3f909efd7fb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:42.527343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7d5a-d1dc-467f-a23c-a3f909efd7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:42.527666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7d5a-d1dc-467f-a23c-a3f909efd7fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:42.528502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7d5a-d1dc-467f-a23c-a3f909efd7fb None admin] RBAC: Adding query filter params (role.id=a9ef6ba6c6a94fc7bcb5d8b628725987, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=dfe692e2ebff459f89835258db961125) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:42.528808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7d5a-d1dc-467f-a23c-a3f909efd7fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:42.530231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7d5a-d1dc-467f-a23c-a3f909efd7fb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:42.536425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 624/1246] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:55:42 2022] GET /identity/v3/role_assignments?user.id=dfe692e2ebff459f89835258db961125&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=a9ef6ba6c6a94fc7bcb5d8b628725987 => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:44.798768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06a74-c418-4574-bbfb-dd19b6d9d616 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:44.799291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06a74-c418-4574-bbfb-dd19b6d9d616 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:44.799407 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06a74-c418-4574-bbfb-dd19b6d9d616 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:44.801476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 623/1247] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:55:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:55:44.806941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654776da-c340-404b-aa86-ffda54e61edf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:44.807368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654776da-c340-404b-aa86-ffda54e61edf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:44.807490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654776da-c340-404b-aa86-ffda54e61edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:44.812476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:44.824607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-654776da-c340-404b-aa86-ffda54e61edf None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:44.825769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-654776da-c340-404b-aa86-ffda54e61edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:44.891510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 625/1248] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:55:44 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:55:44.915412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06a74-c418-4574-bbfb-dd19b6d9d616 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:44.934023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:45.016077 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06a74-c418-4574-bbfb-dd19b6d9d616 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:45.052509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151232c6-dab9-4348-b212-c714a832bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:45.053315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151232c6-dab9-4348-b212-c714a832bff0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:45.053677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151232c6-dab9-4348-b212-c714a832bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:45.053954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151232c6-dab9-4348-b212-c714a832bff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:45.063986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151232c6-dab9-4348-b212-c714a832bff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-151232c6-dab9-4348-b212-c714a832bff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:55:45.072343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:45.073467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:45.074538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 624/1249] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:55:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:45.079650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654776da-c340-404b-aa86-ffda54e61edf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:45.179828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654776da-c340-404b-aa86-ffda54e61edf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:45.209892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:45.214979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:45.215657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:45.215935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:45.216203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:45.216958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:45.222060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:45.222060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:45.227391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 626/1250] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:55:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:45.233358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151232c6-dab9-4348-b212-c714a832bff0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:45.312636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:45.335507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151232c6-dab9-4348-b212-c714a832bff0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:45.368926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:45.369713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:45.369994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:45.370268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:45.381283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:45.382728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:45.400649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:45.401571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:45.402453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:45.402453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:45.402453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:45.402453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:45.402841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 625/1251] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 17:55:45.407675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:45.510224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349ab48-fefd-4cd3-b684-9235bef9e626 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:45.543832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:45.544504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:45.544791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:45.545167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:45.545880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:45.546185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:45.547564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:45.559471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 627/1252] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:45.565820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:45.665168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843a42-c802-49b6-9085-5fafc790db28 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:45.691323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:45.698675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:45.699505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:45.699781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:45.700049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:45.708052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:45.709513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:55:45.723642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:45.724787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:45.725972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 626/1253] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:45.730746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:45.785629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:45.829282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e8fd7-6c34-4197-a14c-06afc3e356d5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:45.861217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:45.862405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:45.862729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:45.863006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:45.863828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:45.864137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:45.865595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:45.882525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 628/1254] 10.222.0.123 () {56 vars in 1148 bytes} [Thu May 26 17:55:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:45.889022 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:45.987580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fceed0-af9d-411e-a707-0535d759f427 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:46.023191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d51c-ff70-4e23-aa4b-283cd70476be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:46.023838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d51c-ff70-4e23-aa4b-283cd70476be None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:46.024125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d51c-ff70-4e23-aa4b-283cd70476be None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:46.024488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d51c-ff70-4e23-aa4b-283cd70476be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:46.078061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:46.090506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d51c-ff70-4e23-aa4b-283cd70476be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:46.091898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d51c-ff70-4e23-aa4b-283cd70476be None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:46.186823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 627/1255] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:55:45 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:55:46.193286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:46.292404 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b284b9-1699-472a-bae8-7046d92fe64b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:46.305709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:46.326752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:46.327523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:46.327797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:46.328064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:46.338335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:46.339766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:46.356804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:46.357862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:46.358789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:46.358789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:46.358789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:46.358789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:46.358789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 629/1256] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:46.363938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d51c-ff70-4e23-aa4b-283cd70476be None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:46.450571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:46.462498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d51c-ff70-4e23-aa4b-283cd70476be None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:46.495002 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:46.495651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:46.495929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:46.496201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:46.496936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:46.497239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:46.498596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:46.510410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 628/1257] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:46.515953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:46.613179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8720d09-c1ed-4823-b339-b0a947b23706 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:46.646741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:46.647515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:46.647798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:46.648077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:46.654559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:46.656005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:55:46.669574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:46.670581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:46.671498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 630/1258] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:46.677397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:46.775952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5850-391c-4522-a8d8-7dc325e06fc8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:46.809268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4218-568d-430a-b41f-aa2975e27b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:46.809961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4218-568d-430a-b41f-aa2975e27b68 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:46.810238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4218-568d-430a-b41f-aa2975e27b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:46.810508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4218-568d-430a-b41f-aa2975e27b68 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:46.811409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4218-568d-430a-b41f-aa2975e27b68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:46.811879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4218-568d-430a-b41f-aa2975e27b68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:46.813488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4218-568d-430a-b41f-aa2975e27b68 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:46.826491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 629/1259] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:55:46.832973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:46.860659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:46.939344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115936-b954-4220-b85d-b2a6d9278454 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:46.973925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fa4da-899f-4095-9762-2e4a13a01849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:46.974568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa4da-899f-4095-9762-2e4a13a01849 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:46.974848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa4da-899f-4095-9762-2e4a13a01849 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:46.975120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fa4da-899f-4095-9762-2e4a13a01849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:46.976103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fa4da-899f-4095-9762-2e4a13a01849 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=dfe692e2ebff459f89835258db961125) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:46.976449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fa4da-899f-4095-9762-2e4a13a01849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:46.977888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fa4da-899f-4095-9762-2e4a13a01849 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:46.983685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 631/1260] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:55:46 2022] GET /identity/v3/role_assignments?user.id=dfe692e2ebff459f89835258db961125&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:49.289099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe159-aa56-49e4-8dd0-b3abbf19b6eb None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:49.289620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe159-aa56-49e4-8dd0-b3abbf19b6eb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:49.289744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe159-aa56-49e4-8dd0-b3abbf19b6eb None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:49.291059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 630/1261] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:55:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:55:49.296241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ee4cc-34c1-412d-82a5-cdd4d39bd291 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:49.296706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ee4cc-34c1-412d-82a5-cdd4d39bd291 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:49.296814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ee4cc-34c1-412d-82a5-cdd4d39bd291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:49.313471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e87ee4cc-34c1-412d-82a5-cdd4d39bd291 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:49.314639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e87ee4cc-34c1-412d-82a5-cdd4d39bd291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:49.379764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 632/1262] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:55:49 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:55:49.403245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe159-aa56-49e4-8dd0-b3abbf19b6eb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:49.415379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:49.507750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe159-aa56-49e4-8dd0-b3abbf19b6eb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:49.541484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8eaf5-77ed-4fd7-8079-198b915660b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:49.542218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8eaf5-77ed-4fd7-8079-198b915660b6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:49.542494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8eaf5-77ed-4fd7-8079-198b915660b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:49.542762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8eaf5-77ed-4fd7-8079-198b915660b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:49.553088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8eaf5-77ed-4fd7-8079-198b915660b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-22b8eaf5-77ed-4fd7-8079-198b915660b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:55:49.560703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:49.561785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:49.562683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 631/1263] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:55:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:49.568790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ee4cc-34c1-412d-82a5-cdd4d39bd291 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:49.586814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:49.665458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ee4cc-34c1-412d-82a5-cdd4d39bd291 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:49.698968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:49.699708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:49.699987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:49.700256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:49.701010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:49.701313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:49.702672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:49.711836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 633/1264] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:55:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:49.717810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8eaf5-77ed-4fd7-8079-198b915660b6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:49.783861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:49.817954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8eaf5-77ed-4fd7-8079-198b915660b6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:49.851460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:49.852373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:49.852630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:49.852897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:49.863591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:49.865088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:49.883513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:49.884993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:49.886087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:49.886087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:49.886087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:49.886087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:49.886087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 632/1265] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:49.891092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:49.971950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:49.991390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e1efd-aa12-4ef3-80b0-cc70eeb5f023 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:50.024756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:50.031914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:50.031914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:50.031914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:50.031914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:50.031914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:50.031914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:50.040688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 634/1266] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:50.046536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:50.146792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63edec-fc0e-4b47-b394-8d2720d0e435 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:50.166132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:50.180244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:50.181050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:50.181327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:50.181597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:50.188766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:50.191013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:55:50.204596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:50.206861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:50.208031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 633/1267] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:50.212245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:50.315703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e66da3-77e2-4351-a12a-298b641b3dce None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:50.348374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:50.349029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:50.349307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:50.349661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:50.350398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:50.350703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:50.352144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:50.360545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:50.369287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 635/1268] 10.222.0.123 () {56 vars in 1148 bytes} [Thu May 26 17:55:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:50.375029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:50.475817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84200ff-d67e-4b41-8795-7c26d8fbd69b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:50.508849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:50.509949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:50.510231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:50.510498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:50.520642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:50.522164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:50.539600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:50.541206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:50.542382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:50.542382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:50.542382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:50.542382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:50.542382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 634/1269] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:50.546670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:50.652555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641219f-f2d9-4b8d-b489-24b76f6bc4cb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:50.687803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d38946-32e9-492a-831f-beec5554651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:50.688481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d38946-32e9-492a-831f-beec5554651f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:50.688759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d38946-32e9-492a-831f-beec5554651f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:50.689029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d38946-32e9-492a-831f-beec5554651f None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:50.689804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d38946-32e9-492a-831f-beec5554651f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:50.690098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d38946-32e9-492a-831f-beec5554651f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:50.691464 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d38946-32e9-492a-831f-beec5554651f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:50.702519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 636/1270] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:50.708803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:50.744872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:50.812701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcae945-d270-4e8b-9091-d3da798a2d3d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:50.844682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:50.845652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:50.845958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:50.847280 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:50.854245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:50.855671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:55:50.871185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:50.872271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:50.873333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 635/1271] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:50.878318 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d38946-32e9-492a-831f-beec5554651f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:50.938262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:50.981861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d38946-32e9-492a-831f-beec5554651f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:51.015730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688c698-ec96-422d-875e-47ca445e62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:51.016297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c698-ec96-422d-875e-47ca445e62f8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:51.016596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c698-ec96-422d-875e-47ca445e62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:51.016870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688c698-ec96-422d-875e-47ca445e62f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:51.017634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688c698-ec96-422d-875e-47ca445e62f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:51.018825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688c698-ec96-422d-875e-47ca445e62f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:51.019888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688c698-ec96-422d-875e-47ca445e62f8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:51.031553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 637/1272] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:55:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:51.038236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:51.126666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:51.135812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1162f-b7ed-440d-968d-d966923c6847 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:51.170297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04142003-814c-4e5f-af49-598a88f1ae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:51.171379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142003-814c-4e5f-af49-598a88f1ae33 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:51.171661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142003-814c-4e5f-af49-598a88f1ae33 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:51.171931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04142003-814c-4e5f-af49-598a88f1ae33 None admin] PATH_INFO: `/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/dfe692e2ebff459f89835258db961125/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:51.174813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142003-814c-4e5f-af49-598a88f1ae33 None admin] RBAC: Authorizing `identity:create_grant(project_id=a99cda0f0ded4bf184bfd61871340453, user_id=dfe692e2ebff459f89835258db961125, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:51.176638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04142003-814c-4e5f-af49-598a88f1ae33 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:51.357413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 636/1273] 10.222.0.123 () {58 vars in 1444 bytes} [Thu May 26 17:55:51 2022] PUT /identity/v3/projects/a99cda0f0ded4bf184bfd61871340453/users/dfe692e2ebff459f89835258db961125/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:55:53.562913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1471-e597-4f1a-a5a4-e73d7e153042 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:53.563412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1471-e597-4f1a-a5a4-e73d7e153042 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:53.563412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1471-e597-4f1a-a5a4-e73d7e153042 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:53.564784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 638/1274] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:55:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:55:53.571172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483dd67-974e-415e-85c2-a37005e07ea1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:53.575837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483dd67-974e-415e-85c2-a37005e07ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:53.575837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483dd67-974e-415e-85c2-a37005e07ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:53.587992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8483dd67-974e-415e-85c2-a37005e07ea1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:53.589208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8483dd67-974e-415e-85c2-a37005e07ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:53.662100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 637/1275] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:55:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:55:53.686416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1471-e597-4f1a-a5a4-e73d7e153042 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:53.792352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1471-e597-4f1a-a5a4-e73d7e153042 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:53.809928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:53.826282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763e83-a681-4c3a-840b-7b17a0885815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:53.827062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763e83-a681-4c3a-840b-7b17a0885815 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:53.827339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763e83-a681-4c3a-840b-7b17a0885815 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:53.827610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763e83-a681-4c3a-840b-7b17a0885815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:53.837495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33763e83-a681-4c3a-840b-7b17a0885815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-33763e83-a681-4c3a-840b-7b17a0885815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 17:55:53.845240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:53.847293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 17:55:53.848164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:53.852162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 639/1276] 10.222.0.123 () {56 vars in 1101 bytes} [Thu May 26 17:55:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:53.853185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483dd67-974e-415e-85c2-a37005e07ea1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:53.932889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:53.950017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483dd67-974e-415e-85c2-a37005e07ea1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:53.982947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:53.983598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:53.983873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:53.984146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:53.984902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:53.985202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:53.986597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:53.994342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 638/1277] 10.222.0.123 () {56 vars in 1104 bytes} [Thu May 26 17:55:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:55:53.999961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763e83-a681-4c3a-840b-7b17a0885815 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:54.108601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763e83-a681-4c3a-840b-7b17a0885815 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:54.143418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:54.144203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:54.144514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:54.144792 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:54.154999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:54.156524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:54.175274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:54.176411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:54.177799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:54.177799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:54.177799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:54.177799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:54.177799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 640/1278] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:54.182077 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:54.284067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cadcb6-426d-4e72-b51c-a94f0ba73f9f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:54.319435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:54.320085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:54.320396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:54.320667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:54.321374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:54.321708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:54.323360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:54.334892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 639/1279] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:54.340635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:54.372537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:54.441964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52069630-b6e7-4edf-a9cc-40669c4bf2cc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:54.475140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:54.475921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:54.476212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:54.476523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:54.484834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:54.486285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 17:55:54.500803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:54.506495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:54.507922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 641/1280] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:54.508803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:54.512148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:54.606010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2f3e-f51d-4297-b948-ca299145d62f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:54.639945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:54.640556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:54.640839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:54.641105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:54.641916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:54.642220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:54.643796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:54.661395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 640/1281] 10.222.0.123 () {56 vars in 1148 bytes} [Thu May 26 17:55:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:54.667263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:54.759776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:54.769804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a614-4506-463f-9f06-591aa67410f5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:54.803705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb32d0-3336-456c-8d77-1569cc74c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:54.804360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb32d0-3336-456c-8d77-1569cc74c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:54.804643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb32d0-3336-456c-8d77-1569cc74c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:54.804914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb32d0-3336-456c-8d77-1569cc74c0d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:54.873728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb32d0-3336-456c-8d77-1569cc74c0d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:54.875283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb32d0-3336-456c-8d77-1569cc74c0d3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:54.970304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:54.980954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 642/1282] 10.222.0.123 () {58 vars in 1287 bytes} [Thu May 26 17:55:54 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 17:55:54.987296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:55.049332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:55.086246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535fdbf-88f2-450d-83ad-23929590b0c0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:55.120484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:55.121370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:55.121647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:55.121911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:55.131604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:55.133317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 17:55:55.152220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:55.153320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:55.154488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 17:55:55.154488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 17:55:55.154488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 17:55:55.154488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:55.154488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 641/1283] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 17:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:55.159920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb32d0-3336-456c-8d77-1569cc74c0d3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:55.258121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb32d0-3336-456c-8d77-1569cc74c0d3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:55.291562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:55.292210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:55.292513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:55.292784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:55.293517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:55.293844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:55.295189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:55.306811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 643/1284] 10.222.0.123 () {56 vars in 1114 bytes} [Thu May 26 17:55:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:55.312682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:55.415897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1098b1e-612d-447e-b803-f53b320cd801 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:55.432392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:55.451522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:55.452297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:55.452598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:55.452866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:55.459744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:55.461197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 17:55:55.475652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:55.476764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application May 26 17:55:55.477657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 642/1285] 10.222.0.123 () {56 vars in 1116 bytes} [Thu May 26 17:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:55.482855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:55.538203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:55.586369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb6a83-84b6-49cd-9292-525e5e1b6858 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:55.619184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315398-209a-416b-9a4b-980c9ac8a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:55.619826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315398-209a-416b-9a4b-980c9ac8a5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:55.620103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315398-209a-416b-9a4b-980c9ac8a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:55.620440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315398-209a-416b-9a4b-980c9ac8a5c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:55.621212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d315398-209a-416b-9a4b-980c9ac8a5c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:55.621590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d315398-209a-416b-9a4b-980c9ac8a5c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:55.623237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d315398-209a-416b-9a4b-980c9ac8a5c2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:55.635490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 644/1286] 10.222.0.123 () {56 vars in 1153 bytes} [Thu May 26 17:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:55.642324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:55.757536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37d3eb-410e-4cd3-aa51-a24e1980b2f6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:55.793861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1ceb8-b950-45ce-b119-c5211e79f907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:55.794435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1ceb8-b950-45ce-b119-c5211e79f907 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:55.794715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1ceb8-b950-45ce-b119-c5211e79f907 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:55.794986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1ceb8-b950-45ce-b119-c5211e79f907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:55.795892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1ceb8-b950-45ce-b119-c5211e79f907 None admin] RBAC: Adding query filter params (role.id=6e7cd2f56dab404082420e2f568d3460, scope.project.id=a99cda0f0ded4bf184bfd61871340453, user.id=dfe692e2ebff459f89835258db961125) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:55.796194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1ceb8-b950-45ce-b119-c5211e79f907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:55.797651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1ceb8-b950-45ce-b119-c5211e79f907 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:55.803601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 643/1287] 10.222.0.123 () {56 vars in 1379 bytes} [Thu May 26 17:55:55 2022] GET /identity/v3/role_assignments?user.id=dfe692e2ebff459f89835258db961125&scope.project.id=a99cda0f0ded4bf184bfd61871340453&role.id=6e7cd2f56dab404082420e2f568d3460 => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:55:58.034728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6361b-6423-406b-9899-a6e0b5606e7c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:58.035316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6361b-6423-406b-9899-a6e0b5606e7c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:58.035316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6361b-6423-406b-9899-a6e0b5606e7c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:58.036713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 645/1288] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:55:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:55:58.042569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd0f1-f9e1-4a50-948c-81cc5b7adb0d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:58.043012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd0f1-f9e1-4a50-948c-81cc5b7adb0d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:58.043131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd0f1-f9e1-4a50-948c-81cc5b7adb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:58.059877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9c6cd0f1-f9e1-4a50-948c-81cc5b7adb0d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:55:58.061090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9c6cd0f1-f9e1-4a50-948c-81cc5b7adb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:55:58.090635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:58.126735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 644/1289] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:55:58 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:55:58.149859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6361b-6423-406b-9899-a6e0b5606e7c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:58.249582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6361b-6423-406b-9899-a6e0b5606e7c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:58.261809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:58.285357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:58.286074 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:58.286354 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:58.286629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:58.287301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:58.288709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:55:58.300757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:55:58.306814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:55:58.307916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 646/1290] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:55:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:55:58.308991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd0f1-f9e1-4a50-948c-81cc5b7adb0d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:58.405918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd0f1-f9e1-4a50-948c-81cc5b7adb0d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:58.442087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b6f92-ba30-4f5e-a721-16caf0c32a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:58.442747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b6f92-ba30-4f5e-a721-16caf0c32a22 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:58.443030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b6f92-ba30-4f5e-a721-16caf0c32a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:58.443308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b6f92-ba30-4f5e-a721-16caf0c32a22 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:58.444008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b6f92-ba30-4f5e-a721-16caf0c32a22 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:58.444339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b6f92-ba30-4f5e-a721-16caf0c32a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:58.445711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b6f92-ba30-4f5e-a721-16caf0c32a22 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:58.450645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 645/1291] 10.222.0.123 () {56 vars in 1121 bytes} [Thu May 26 17:55:58 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 17:55:58.457383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:55:58.555706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59870ec5-603e-4031-8184-c8041d11a107 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:55:58.588192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4dbb0-e2da-4e53-a186-a9bd0a4573f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:55:58.588861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dbb0-e2da-4e53-a186-a9bd0a4573f1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:55:58.589140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dbb0-e2da-4e53-a186-a9bd0a4573f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:55:58.589409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dbb0-e2da-4e53-a186-a9bd0a4573f1 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:55:58.590099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4dbb0-e2da-4e53-a186-a9bd0a4573f1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:55:58.590402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4dbb0-e2da-4e53-a186-a9bd0a4573f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:55:58.591763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4dbb0-e2da-4e53-a186-a9bd0a4573f1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:55:58.596194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 647/1292] 10.222.0.123 () {56 vars in 1121 bytes} [Thu May 26 17:55:58 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:56:00.781321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf6a1-a514-4b4a-a78d-7033e3c5bab9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:00.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf6a1-a514-4b4a-a78d-7033e3c5bab9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:00.781878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf6a1-a514-4b4a-a78d-7033e3c5bab9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:00.783941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 646/1293] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:56:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:56:00.789320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55bc90-f969-44d2-8601-f0fac0516199 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:00.789725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55bc90-f969-44d2-8601-f0fac0516199 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:00.789898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55bc90-f969-44d2-8601-f0fac0516199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:00.806567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ad55bc90-f969-44d2-8601-f0fac0516199 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:56:00.807800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ad55bc90-f969-44d2-8601-f0fac0516199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:56:00.838883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:00.875764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 648/1294] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:56:00 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:56:00.899519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cf6a1-a514-4b4a-a78d-7033e3c5bab9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:56:00.930970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:00.999522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cf6a1-a514-4b4a-a78d-7033e3c5bab9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:56:01.034295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff502bd-2f8d-42f3-9964-de066d8b6f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:56:01.034874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff502bd-2f8d-42f3-9964-de066d8b6f21 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:01.035146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff502bd-2f8d-42f3-9964-de066d8b6f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:01.035413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff502bd-2f8d-42f3-9964-de066d8b6f21 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:01.036115 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff502bd-2f8d-42f3-9964-de066d8b6f21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:56:01.037496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff502bd-2f8d-42f3-9964-de066d8b6f21 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:56:01.216463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 647/1295] 10.222.0.123 () {60 vars in 1146 bytes} [Thu May 26 17:56:00 2022] POST /identity/v3/services => generated 247 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:56:03.466933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6bc9b-0af3-4901-a2eb-b63804905285 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:03.467498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6bc9b-0af3-4901-a2eb-b63804905285 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:03.467498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6bc9b-0af3-4901-a2eb-b63804905285 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:03.468961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 649/1296] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:56:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:56:03.475341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e18d9-347d-493c-90d5-32b2229cbef0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:03.475846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e18d9-347d-493c-90d5-32b2229cbef0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:03.475937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e18d9-347d-493c-90d5-32b2229cbef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:03.493606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-783e18d9-347d-493c-90d5-32b2229cbef0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:56:03.494817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-783e18d9-347d-493c-90d5-32b2229cbef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:56:03.577875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 648/1297] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:56:03 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:56:03.602526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6bc9b-0af3-4901-a2eb-b63804905285 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:56:03.712431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6bc9b-0af3-4901-a2eb-b63804905285 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:56:03.750488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:56:03.751288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:03.751636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:03.752405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] PATH_INFO: `/v3/services/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:03.753086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:56:03.754483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:56:03.766742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:56:03.768904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:56:03.769763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 650/1298] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:56:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:56:03.775270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e18d9-347d-493c-90d5-32b2229cbef0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:56:03.796082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:03.878218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e18d9-347d-493c-90d5-32b2229cbef0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:56:03.912904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:56:03.913561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:03.913839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:03.914110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:03.914801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:56:03.915194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:56:03.916587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:56:03.921908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 649/1299] 10.222.0.123 () {56 vars in 1121 bytes} [Thu May 26 17:56:03 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:56:03.927974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:56:03.959750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:04.029098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c154ad3-ba84-461d-b802-c3b07ef2c2da None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:56:04.063016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfd223-2457-4b97-8f94-ad927d52feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:56:04.063652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfd223-2457-4b97-8f94-ad927d52feca None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:04.063933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfd223-2457-4b97-8f94-ad927d52feca None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:04.064264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfd223-2457-4b97-8f94-ad927d52feca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:04.065068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfd223-2457-4b97-8f94-ad927d52feca None admin] RBAC: Adding query filter params (interface=public, service_id=217d5dd2cbfa4a539566224ebcbe0deb, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:56:04.065378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfd223-2457-4b97-8f94-ad927d52feca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:56:04.066735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfd223-2457-4b97-8f94-ad927d52feca None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:56:04.071751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 651/1300] 10.222.0.123 () {56 vars in 1256 bytes} [Thu May 26 17:56:03 2022] GET /identity/v3/endpoints?service_id=217d5dd2cbfa4a539566224ebcbe0deb&interface=public®ion_id=RegionOne => generated 195 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:56:04.077461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:56:04.157205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:04.174916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e9332-8a86-4a88-aaa3-6dbae5fa5455 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:56:04.209658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbd55e-6ce2-40a3-81c4-fb24d5378234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:56:04.210312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd55e-6ce2-40a3-81c4-fb24d5378234 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:04.210586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd55e-6ce2-40a3-81c4-fb24d5378234 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:04.210857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd55e-6ce2-40a3-81c4-fb24d5378234 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:04.211519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbd55e-6ce2-40a3-81c4-fb24d5378234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:56:04.212911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbd55e-6ce2-40a3-81c4-fb24d5378234 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:56:04.219702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 650/1301] 10.222.0.123 () {56 vars in 1092 bytes} [Thu May 26 17:56:04 2022] GET /identity/v3/services => generated 2201 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:56:06.496445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eac913-13c4-477d-8dd7-b783d29fb718 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:06.496999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eac913-13c4-477d-8dd7-b783d29fb718 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:06.496999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eac913-13c4-477d-8dd7-b783d29fb718 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:06.498400 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 652/1302] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 17:56:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 17:56:06.503913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b56f1-1cd0-4660-8541-02a11d611a85 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:06.504323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b56f1-1cd0-4660-8541-02a11d611a85 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:06.504497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b56f1-1cd0-4660-8541-02a11d611a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:06.520789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e01b56f1-1cd0-4660-8541-02a11d611a85 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:56:06.521951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e01b56f1-1cd0-4660-8541-02a11d611a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:56:06.588228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 651/1303] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 17:56:06 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 17:56:06.611997 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eac913-13c4-477d-8dd7-b783d29fb718 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:56:06.704094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:06.710878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eac913-13c4-477d-8dd7-b783d29fb718 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:56:06.745596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:56:06.746384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:06.746667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:06.746941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:06.747588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:56:06.749023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 17:56:06.761407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 17:56:06.762615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application May 26 17:56:06.763684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 653/1304] 10.222.0.123 () {56 vars in 1122 bytes} [Thu May 26 17:56:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 17:56:06.769409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b56f1-1cd0-4660-8541-02a11d611a85 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:56:06.843818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:06.865997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b56f1-1cd0-4660-8541-02a11d611a85 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:56:06.899572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce0c9-8b1d-4769-bfad-c46a93e9ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:56:06.900229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce0c9-8b1d-4769-bfad-c46a93e9ed30 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:06.900549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce0c9-8b1d-4769-bfad-c46a93e9ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:06.900829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce0c9-8b1d-4769-bfad-c46a93e9ed30 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:06.901551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ce0c9-8b1d-4769-bfad-c46a93e9ed30 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:56:06.901858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ce0c9-8b1d-4769-bfad-c46a93e9ed30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:56:06.903420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ce0c9-8b1d-4769-bfad-c46a93e9ed30 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:56:06.909722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 652/1305] 10.222.0.123 () {56 vars in 1121 bytes} [Thu May 26 17:56:06 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:56:06.915607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:56:07.023836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ef81-ae7a-4610-b1ae-8f32cfeac47f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:56:07.057924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1633dfd-1611-4585-8d6e-1e9390794c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:56:07.058568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1633dfd-1611-4585-8d6e-1e9390794c34 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:56:07.058845 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1633dfd-1611-4585-8d6e-1e9390794c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:56:07.059116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1633dfd-1611-4585-8d6e-1e9390794c34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:56:07.059850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1633dfd-1611-4585-8d6e-1e9390794c34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:56:07.061233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1633dfd-1611-4585-8d6e-1e9390794c34 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:56:07.156908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 654/1306] 10.222.0.123 () {60 vars in 1149 bytes} [Thu May 26 17:56:06 2022] POST /identity/v3/endpoints => generated 333 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:56:16.957095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=30 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:56:17.152179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:10.056978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b45007-826c-4495-8bfe-78ba2122f040 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:10.057540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b45007-826c-4495-8bfe-78ba2122f040 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:10.057540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b45007-826c-4495-8bfe-78ba2122f040 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:10.064538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b78e1-ddb3-4aba-823b-08631e6b1d37 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:10.068239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b78e1-ddb3-4aba-823b-08631e6b1d37 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:10.068239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b78e1-ddb3-4aba-823b-08631e6b1d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:10.068581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 653/1307] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:10 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:10.148343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ee8b78e1-ddb3-4aba-823b-08631e6b1d37 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:10.149958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ee8b78e1-ddb3-4aba-823b-08631e6b1d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:10.257167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 655/1308] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:03:10.324183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acefdb4-1aa7-4554-a374-02e58fe75498 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:10.325195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acefdb4-1aa7-4554-a374-02e58fe75498 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:10.325533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acefdb4-1aa7-4554-a374-02e58fe75498 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:10.327344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 654/1309] 10.222.0.123 () {54 vars in 969 bytes} [Thu May 26 18:03:10 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:10.335655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab7af3-61a3-4f8f-9e0c-cf3a67f4a083 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:10.335932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab7af3-61a3-4f8f-9e0c-cf3a67f4a083 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:10.336158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab7af3-61a3-4f8f-9e0c-cf3a67f4a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:10.480861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c9ab7af3-61a3-4f8f-9e0c-cf3a67f4a083 None None] MFA Rules not processed for user `66452133fd6348109e3065303947ecce`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:10.482087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c9ab7af3-61a3-4f8f-9e0c-cf3a67f4a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:10.512413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:10.580713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 656/1310] 10.222.0.123 () {58 vars in 1066 bytes} [Thu May 26 18:03:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:03:10.591348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acefdb4-1aa7-4554-a374-02e58fe75498 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:10.593136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2acefdb4-1aa7-4554-a374-02e58fe75498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:10.727693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acefdb4-1aa7-4554-a374-02e58fe75498 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:10.812897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce37e8-04b2-45ed-8149-721d507f49bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:10.814333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce37e8-04b2-45ed-8149-721d507f49bd service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:10.814835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce37e8-04b2-45ed-8149-721d507f49bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:10.815328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce37e8-04b2-45ed-8149-721d507f49bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:10.817199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ecce37e8-04b2-45ed-8149-721d507f49bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:10.883334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:10.946709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce37e8-04b2-45ed-8149-721d507f49bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:10.948602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce37e8-04b2-45ed-8149-721d507f49bd service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:10.974864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 655/1311] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:13.556694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960073-19d9-4cd2-9eec-7df2eb0946d0 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:13.557174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960073-19d9-4cd2-9eec-7df2eb0946d0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:13.557174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960073-19d9-4cd2-9eec-7df2eb0946d0 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:13.558705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 657/1312] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:13.564455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379bf8f-85c1-490f-b32d-0b257fe815c1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:13.565019 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379bf8f-85c1-490f-b32d-0b257fe815c1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:13.565019 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379bf8f-85c1-490f-b32d-0b257fe815c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:13.663013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5379bf8f-85c1-490f-b32d-0b257fe815c1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:13.664222 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5379bf8f-85c1-490f-b32d-0b257fe815c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:13.761230 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 656/1313] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:13.799071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da960073-19d9-4cd2-9eec-7df2eb0946d0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:13.800660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-da960073-19d9-4cd2-9eec-7df2eb0946d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:13.910449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da960073-19d9-4cd2-9eec-7df2eb0946d0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:13.982920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:13.985510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f72c-e757-4dd5-8548-62c80f60f9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:13.986153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f72c-e757-4dd5-8548-62c80f60f9cf service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:13.986431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f72c-e757-4dd5-8548-62c80f60f9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:13.986707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f72c-e757-4dd5-8548-62c80f60f9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:13.988352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-33d2f72c-e757-4dd5-8548-62c80f60f9cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:14.100172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2f72c-e757-4dd5-8548-62c80f60f9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:14.101660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2f72c-e757-4dd5-8548-62c80f60f9cf service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:14.119938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 658/1314] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:16.830826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb11d2-746c-4f91-bd8d-6564f2c1aa09 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:16.831413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb11d2-746c-4f91-bd8d-6564f2c1aa09 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:16.831413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb11d2-746c-4f91-bd8d-6564f2c1aa09 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:16.833759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 657/1315] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:16.839026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f16ba6-cd37-4fd6-9d35-4dd89fd5c1db None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:16.839405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f16ba6-cd37-4fd6-9d35-4dd89fd5c1db None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:16.839587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f16ba6-cd37-4fd6-9d35-4dd89fd5c1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:16.902938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-07f16ba6-cd37-4fd6-9d35-4dd89fd5c1db None None] MFA Rules not processed for user `dac67488793242039b05e7d68aa8f739`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:16.904136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-07f16ba6-cd37-4fd6-9d35-4dd89fd5c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:16.955068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:16.999302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 659/1316] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:17.055809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a225a91-9f54-40fa-9524-cca797490d07 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:17.056095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a225a91-9f54-40fa-9524-cca797490d07 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:17.056409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a225a91-9f54-40fa-9524-cca797490d07 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:17.057785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 658/1317] 10.222.0.123 () {54 vars in 969 bytes} [Thu May 26 18:03:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:17.063565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405baf-066e-473f-b9cb-e1c31cc2d76c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:17.063851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405baf-066e-473f-b9cb-e1c31cc2d76c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:17.064127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405baf-066e-473f-b9cb-e1c31cc2d76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:17.136914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ad405baf-066e-473f-b9cb-e1c31cc2d76c None None] MFA Rules not processed for user `66452133fd6348109e3065303947ecce`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:17.138032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ad405baf-066e-473f-b9cb-e1c31cc2d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:17.214092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 660/1318] 10.222.0.123 () {58 vars in 1066 bytes} [Thu May 26 18:03:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:17.223385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a225a91-9f54-40fa-9524-cca797490d07 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:17.224978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7a225a91-9f54-40fa-9524-cca797490d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:17.235147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:17.329210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a225a91-9f54-40fa-9524-cca797490d07 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:17.400631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c8d23-337d-4dc1-9b7f-d7b8193db531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:17.401191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c8d23-337d-4dc1-9b7f-d7b8193db531 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:17.401463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c8d23-337d-4dc1-9b7f-d7b8193db531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:17.401994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c8d23-337d-4dc1-9b7f-d7b8193db531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:17.403598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-245c8d23-337d-4dc1-9b7f-d7b8193db531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:17.464713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:17.511514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c8d23-337d-4dc1-9b7f-d7b8193db531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:17.512969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c8d23-337d-4dc1-9b7f-d7b8193db531 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:17.530840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 659/1319] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:20.957757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c23d15-199e-4fff-8cdb-37f2f9691799 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:20.958297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c23d15-199e-4fff-8cdb-37f2f9691799 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:20.958297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c23d15-199e-4fff-8cdb-37f2f9691799 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:20.959696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 661/1320] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:20.965009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa916-576b-48ae-ba0f-9259bedacaea None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:20.965433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa916-576b-48ae-ba0f-9259bedacaea None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:20.965555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa916-576b-48ae-ba0f-9259bedacaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:21.029131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ed2aa916-576b-48ae-ba0f-9259bedacaea None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:21.030340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ed2aa916-576b-48ae-ba0f-9259bedacaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:21.126619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 660/1321] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:21.166162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c23d15-199e-4fff-8cdb-37f2f9691799 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:21.167706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-36c23d15-199e-4fff-8cdb-37f2f9691799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:21.217630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:21.271382 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c23d15-199e-4fff-8cdb-37f2f9691799 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:21.347553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b447619-671d-4dc8-8da8-5b76e64a5f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:21.348779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447619-671d-4dc8-8da8-5b76e64a5f21 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:21.349055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447619-671d-4dc8-8da8-5b76e64a5f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:21.349322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447619-671d-4dc8-8da8-5b76e64a5f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:21.350945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6b447619-671d-4dc8-8da8-5b76e64a5f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:21.443570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:21.456521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b447619-671d-4dc8-8da8-5b76e64a5f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:21.458672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b447619-671d-4dc8-8da8-5b76e64a5f21 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:21.477358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 662/1322] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:25.065501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff7ec-c8bd-4c97-aee7-e236c42e1c29 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:25.066681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff7ec-c8bd-4c97-aee7-e236c42e1c29 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:25.066681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff7ec-c8bd-4c97-aee7-e236c42e1c29 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:25.068202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 661/1323] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:25.074452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e65a0-5642-4c81-aa15-f43057601a46 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:25.074874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e65a0-5642-4c81-aa15-f43057601a46 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:25.075016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e65a0-5642-4c81-aa15-f43057601a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:25.143629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-603e65a0-5642-4c81-aa15-f43057601a46 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:25.145310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-603e65a0-5642-4c81-aa15-f43057601a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:25.252881 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 663/1324] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:25.289649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff7ec-c8bd-4c97-aee7-e236c42e1c29 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:25.291232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-37eff7ec-c8bd-4c97-aee7-e236c42e1c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:25.316707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:25.407617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff7ec-c8bd-4c97-aee7-e236c42e1c29 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:25.484283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecb8f9-1060-4b09-aa1b-af958ad03685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:25.484951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb8f9-1060-4b09-aa1b-af958ad03685 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:25.485229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb8f9-1060-4b09-aa1b-af958ad03685 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:25.485503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb8f9-1060-4b09-aa1b-af958ad03685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:25.487112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-19ecb8f9-1060-4b09-aa1b-af958ad03685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:25.561168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:25.601395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecb8f9-1060-4b09-aa1b-af958ad03685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:25.602748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecb8f9-1060-4b09-aa1b-af958ad03685 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:25.621454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 662/1325] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:27.957701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fc949-f0af-49af-89ce-343be9eb319c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:27.958263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fc949-f0af-49af-89ce-343be9eb319c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:27.958263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fc949-f0af-49af-89ce-343be9eb319c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:27.959664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 664/1326] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:27.964992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b37ab8-e552-4434-ae2b-8a3e8eab6890 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:27.965408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b37ab8-e552-4434-ae2b-8a3e8eab6890 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:27.965660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b37ab8-e552-4434-ae2b-8a3e8eab6890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:28.037212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-34b37ab8-e552-4434-ae2b-8a3e8eab6890 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:28.038420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-34b37ab8-e552-4434-ae2b-8a3e8eab6890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:28.140232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 663/1327] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:28.177566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fc949-f0af-49af-89ce-343be9eb319c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:28.179115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b86fc949-f0af-49af-89ce-343be9eb319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:28.241051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:28.288458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fc949-f0af-49af-89ce-343be9eb319c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:28.366307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541d5d5-3cde-4984-b267-56fa9874de11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:28.366949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d5d5-3cde-4984-b267-56fa9874de11 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:28.367231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d5d5-3cde-4984-b267-56fa9874de11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:28.367505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d5d5-3cde-4984-b267-56fa9874de11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:28.369363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a541d5d5-3cde-4984-b267-56fa9874de11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:28.479922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:28.482172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541d5d5-3cde-4984-b267-56fa9874de11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:28.483615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541d5d5-3cde-4984-b267-56fa9874de11 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:28.501990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 665/1328] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:30.787417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ffea-3652-4668-baae-82be948cf01f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:30.787952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ffea-3652-4668-baae-82be948cf01f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:30.788150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ffea-3652-4668-baae-82be948cf01f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:30.789732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 664/1329] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:30.794787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e16f-cc60-4212-a177-6a95301e22ba None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:30.795214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e16f-cc60-4212-a177-6a95301e22ba None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:30.795337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e16f-cc60-4212-a177-6a95301e22ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:30.859465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0b08e16f-cc60-4212-a177-6a95301e22ba None None] MFA Rules not processed for user `dac67488793242039b05e7d68aa8f739`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:30.860693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0b08e16f-cc60-4212-a177-6a95301e22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:30.959234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 666/1330] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:30.995994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ffea-3652-4668-baae-82be948cf01f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:30.997641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-46a9ffea-3652-4668-baae-82be948cf01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:31.030757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:31.104525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ffea-3652-4668-baae-82be948cf01f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:31.181546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7d9d-8793-49b7-b84e-735db32413ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:31.182200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7d9d-8793-49b7-b84e-735db32413ee service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:31.182480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7d9d-8793-49b7-b84e-735db32413ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:31.182754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7d9d-8793-49b7-b84e-735db32413ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:31.184420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fc6f7d9d-8793-49b7-b84e-735db32413ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:31.262078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:31.294687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7d9d-8793-49b7-b84e-735db32413ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:31.296137 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7d9d-8793-49b7-b84e-735db32413ee service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:31.314674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 665/1331] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:33.978678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddf56a-5b29-406e-83c8-eb1162f8279e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:33.979188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddf56a-5b29-406e-83c8-eb1162f8279e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:33.979188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddf56a-5b29-406e-83c8-eb1162f8279e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:33.980599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 667/1332] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:33.986008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a553c-4c88-4085-adef-80d7d03339ad None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:33.986428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a553c-4c88-4085-adef-80d7d03339ad None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:33.986533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a553c-4c88-4085-adef-80d7d03339ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:34.055738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f27a553c-4c88-4085-adef-80d7d03339ad None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:34.056983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f27a553c-4c88-4085-adef-80d7d03339ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:34.167390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 666/1333] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:34.204907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddf56a-5b29-406e-83c8-eb1162f8279e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:34.207083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4dddf56a-5b29-406e-83c8-eb1162f8279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:34.282205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:34.321393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddf56a-5b29-406e-83c8-eb1162f8279e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:34.418908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0bbaa-d098-4f71-b6c6-c2085002ab68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:34.418908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0bbaa-d098-4f71-b6c6-c2085002ab68 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:34.418908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0bbaa-d098-4f71-b6c6-c2085002ab68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:34.418908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0bbaa-d098-4f71-b6c6-c2085002ab68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:34.419320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-70f0bbaa-d098-4f71-b6c6-c2085002ab68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:34.544941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0bbaa-d098-4f71-b6c6-c2085002ab68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:34.546991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0bbaa-d098-4f71-b6c6-c2085002ab68 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:34.558364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:34.570473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 668/1334] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:36.864506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea238-421f-4078-82ad-c63a24383c92 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:36.865044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea238-421f-4078-82ad-c63a24383c92 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:36.865044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea238-421f-4078-82ad-c63a24383c92 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:36.866426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 667/1335] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:36.871684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c440b6-41ad-4ef0-bb9e-7cd923e2f18d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:36.872104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c440b6-41ad-4ef0-bb9e-7cd923e2f18d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:36.872238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c440b6-41ad-4ef0-bb9e-7cd923e2f18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:36.935097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c5c440b6-41ad-4ef0-bb9e-7cd923e2f18d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:36.936334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c5c440b6-41ad-4ef0-bb9e-7cd923e2f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:37.038401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 669/1336] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:37.077533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ea238-421f-4078-82ad-c63a24383c92 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:37.079077 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cd0ea238-421f-4078-82ad-c63a24383c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:37.119414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:37.184293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ea238-421f-4078-82ad-c63a24383c92 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:37.257464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4275f0f-3747-4688-9274-9961981ebdb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:37.258106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4275f0f-3747-4688-9274-9961981ebdb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:37.258385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4275f0f-3747-4688-9274-9961981ebdb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:37.258659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4275f0f-3747-4688-9274-9961981ebdb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:37.260291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b4275f0f-3747-4688-9274-9961981ebdb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:37.347601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:37.373271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4275f0f-3747-4688-9274-9961981ebdb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:37.374666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4275f0f-3747-4688-9274-9961981ebdb9 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:37.394840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 668/1337] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:40.355773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf096f5c-9c41-42ef-8a9d-68c280d73eed None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:40.356361 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf096f5c-9c41-42ef-8a9d-68c280d73eed None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:40.356361 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf096f5c-9c41-42ef-8a9d-68c280d73eed None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:40.357638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 670/1338] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:40.363125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e9b8-5820-4ae2-bf57-a4d098e1b5f5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:40.363601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e9b8-5820-4ae2-bf57-a4d098e1b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:40.363705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40e9b8-5820-4ae2-bf57-a4d098e1b5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:40.430195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0b40e9b8-5820-4ae2-bf57-a4d098e1b5f5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:40.431410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0b40e9b8-5820-4ae2-bf57-a4d098e1b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:40.533221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 669/1339] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:40.570060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf096f5c-9c41-42ef-8a9d-68c280d73eed None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:40.573498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bf096f5c-9c41-42ef-8a9d-68c280d73eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:40.657276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:40.700028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf096f5c-9c41-42ef-8a9d-68c280d73eed None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:40.704296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b95f7d-e587-4838-8232-02a7631f170f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:40.705395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b95f7d-e587-4838-8232-02a7631f170f service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:40.705677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b95f7d-e587-4838-8232-02a7631f170f service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:40.706163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b95f7d-e587-4838-8232-02a7631f170f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:40.708105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-81b95f7d-e587-4838-8232-02a7631f170f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:40.813428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b95f7d-e587-4838-8232-02a7631f170f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:40.815659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b95f7d-e587-4838-8232-02a7631f170f service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:40.834704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 671/1340] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:45.416288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f53-caff-4517-a38d-4a7dee53e174 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.416827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f53-caff-4517-a38d-4a7dee53e174 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.416908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f53-caff-4517-a38d-4a7dee53e174 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.418396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 670/1341] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:45.424323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cefee-4ba3-4294-9393-a7598573911b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.424740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cefee-4ba3-4294-9393-a7598573911b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.424985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cefee-4ba3-4294-9393-a7598573911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.476644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-780cefee-4ba3-4294-9393-a7598573911b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:45.477841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-780cefee-4ba3-4294-9393-a7598573911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:45.537946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:45.560331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 672/1342] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:45.599062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9f53-caff-4517-a38d-4a7dee53e174 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:45.610536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9f53-caff-4517-a38d-4a7dee53e174 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:45.614683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8d18-b9f1-41f3-81d2-d46aba4617ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:45.615309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8d18-b9f1-41f3-81d2-d46aba4617ac service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:45.615588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8d18-b9f1-41f3-81d2-d46aba4617ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:45.615858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8d18-b9f1-41f3-81d2-d46aba4617ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:45.624757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a8d18-b9f1-41f3-81d2-d46aba4617ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:45.626170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a8d18-b9f1-41f3-81d2-d46aba4617ac service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:45.635496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 671/1343] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:03:48.774610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c92e1-f13f-4833-9d58-3af6dc2e71e3 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:48.775403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c92e1-f13f-4833-9d58-3af6dc2e71e3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:48.775403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c92e1-f13f-4833-9d58-3af6dc2e71e3 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:48.776843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 673/1344] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:48.782131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a4d2-1bba-4533-9c1b-d4bf23e181be None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:48.783395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a4d2-1bba-4533-9c1b-d4bf23e181be None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:48.783395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a4d2-1bba-4533-9c1b-d4bf23e181be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:48.810544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8817a4d2-1bba-4533-9c1b-d4bf23e181be None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:48.811746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8817a4d2-1bba-4533-9c1b-d4bf23e181be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:48.819560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 672/1345] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:48.856420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c92e1-f13f-4833-9d58-3af6dc2e71e3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:48.867711 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c92e1-f13f-4833-9d58-3af6dc2e71e3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:48.871224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b2ac6-f366-4de6-a7cf-3e8af47ade4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:48.871843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b2ac6-f366-4de6-a7cf-3e8af47ade4b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:48.872116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b2ac6-f366-4de6-a7cf-3e8af47ade4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:48.872416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b2ac6-f366-4de6-a7cf-3e8af47ade4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:48.885258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b2ac6-f366-4de6-a7cf-3e8af47ade4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:48.887406 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b2ac6-f366-4de6-a7cf-3e8af47ade4b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:48.897603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 674/1346] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:53.385704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f7f6-3bae-494d-aed4-962af7fa39e2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:53.386261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f7f6-3bae-494d-aed4-962af7fa39e2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:53.386261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f7f6-3bae-494d-aed4-962af7fa39e2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:53.387766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 673/1347] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:03:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:53.393335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5e7ff-31cb-490d-b283-14937b8f65bc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:53.393798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5e7ff-31cb-490d-b283-14937b8f65bc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:53.393893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5e7ff-31cb-490d-b283-14937b8f65bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:53.412646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-08a5e7ff-31cb-490d-b283-14937b8f65bc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:53.413888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-08a5e7ff-31cb-490d-b283-14937b8f65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:53.421858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 675/1348] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:03:53.460178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f7f6-3bae-494d-aed4-962af7fa39e2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:03:53.461746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9445f7f6-3bae-494d-aed4-962af7fa39e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:53.476331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445f7f6-3bae-494d-aed4-962af7fa39e2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:03:53.479832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a310c-9e7b-4744-b5a8-3e82cf753974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:03:53.480504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a310c-9e7b-4744-b5a8-3e82cf753974 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:53.480788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a310c-9e7b-4744-b5a8-3e82cf753974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:53.481067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a310c-9e7b-4744-b5a8-3e82cf753974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:53.490252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a310c-9e7b-4744-b5a8-3e82cf753974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:03:53.491682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a310c-9e7b-4744-b5a8-3e82cf753974 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:03:53.501491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 674/1349] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:03:59.169700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea851ec-de82-41ea-ac00-cd95bad1b956 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.170211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea851ec-de82-41ea-ac00-cd95bad1b956 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.170306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea851ec-de82-41ea-ac00-cd95bad1b956 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.171860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 676/1350] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:03:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:03:59.177448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75eceb-4b1c-4057-b619-5cc444d28e25 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:03:59.177873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75eceb-4b1c-4057-b619-5cc444d28e25 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:03:59.177985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75eceb-4b1c-4057-b619-5cc444d28e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:03:59.181480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:59.259309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ac75eceb-4b1c-4057-b619-5cc444d28e25 None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:03:59.260524 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ac75eceb-4b1c-4057-b619-5cc444d28e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:03:59.338679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 675/1351] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:03:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:03.407222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=15 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:03.865503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555154-9364-4df0-baf3-9bbe348951b1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:03.865784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555154-9364-4df0-baf3-9bbe348951b1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:03.866488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555154-9364-4df0-baf3-9bbe348951b1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:03.868605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 677/1352] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:04:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:03.874509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72605cbe-29cb-40de-b539-488cb757b58e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:03.875344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72605cbe-29cb-40de-b539-488cb757b58e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:03.875344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72605cbe-29cb-40de-b539-488cb757b58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:03.894958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-72605cbe-29cb-40de-b539-488cb757b58e None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:03.896154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-72605cbe-29cb-40de-b539-488cb757b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:03.905062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 676/1353] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:04:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:05.301939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab88cf5-d4b3-4677-87f8-6bcfb3a05937 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:05.302379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab88cf5-d4b3-4677-87f8-6bcfb3a05937 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:05.302468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab88cf5-d4b3-4677-87f8-6bcfb3a05937 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:05.303981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 678/1354] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:04:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:05.308813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc4ba5-39ca-4491-9a77-17fe05c35c6e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:05.309190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc4ba5-39ca-4491-9a77-17fe05c35c6e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:05.309456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc4ba5-39ca-4491-9a77-17fe05c35c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:05.328835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7cbc4ba5-39ca-4491-9a77-17fe05c35c6e None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:05.330060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7cbc4ba5-39ca-4491-9a77-17fe05c35c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:05.338572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 677/1355] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:04:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:09.245183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780f39-fd4d-4c5f-a253-8998b6c34a5d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:09.245799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780f39-fd4d-4c5f-a253-8998b6c34a5d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:09.245799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c780f39-fd4d-4c5f-a253-8998b6c34a5d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:09.247232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 679/1356] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:09.252445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d3627-4f80-41bb-8760-bdbb8cf0d535 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:09.252897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d3627-4f80-41bb-8760-bdbb8cf0d535 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:09.253005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d3627-4f80-41bb-8760-bdbb8cf0d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:09.271989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-844d3627-4f80-41bb-8760-bdbb8cf0d535 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:09.273475 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-844d3627-4f80-41bb-8760-bdbb8cf0d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:09.288683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 678/1357] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:09.338184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b73b-2abc-4319-8543-79dbfe40f09b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:09.339848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b73b-2abc-4319-8543-79dbfe40f09b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:09.340373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b73b-2abc-4319-8543-79dbfe40f09b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:09.342330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 680/1358] 10.222.0.123 () {54 vars in 966 bytes} [Thu May 26 18:04:09 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:09.354328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837f36-1e9b-4285-885e-e2c3e8ef52ca None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:09.355038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837f36-1e9b-4285-885e-e2c3e8ef52ca None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:09.355553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837f36-1e9b-4285-885e-e2c3e8ef52ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:09.409493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4d837f36-1e9b-4285-885e-e2c3e8ef52ca None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:09.411171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4d837f36-1e9b-4285-885e-e2c3e8ef52ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:09.467925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:09.497968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 679/1359] 10.222.0.123 () {58 vars in 1063 bytes} [Thu May 26 18:04:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:09.508339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87b73b-2abc-4319-8543-79dbfe40f09b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:09.525121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87b73b-2abc-4319-8543-79dbfe40f09b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:09.529354 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5bfd2-8806-4a89-9aab-d924439902f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:09.529981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5bfd2-8806-4a89-9aab-d924439902f7 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:09.530371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5bfd2-8806-4a89-9aab-d924439902f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:09.530672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5bfd2-8806-4a89-9aab-d924439902f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:09.539197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5bfd2-8806-4a89-9aab-d924439902f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:09.540927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5bfd2-8806-4a89-9aab-d924439902f7 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:09.561391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 681/1360] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:04:12.011935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cc5e-8f81-48eb-a5d4-04915f67857a None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:12.012544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cc5e-8f81-48eb-a5d4-04915f67857a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:12.012544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cc5e-8f81-48eb-a5d4-04915f67857a None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:12.014063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 680/1361] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:12.019921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed48a-ea44-440e-a961-c40d22edb62d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:12.020389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed48a-ea44-440e-a961-c40d22edb62d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:12.020502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eed48a-ea44-440e-a961-c40d22edb62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:12.038521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-48eed48a-ea44-440e-a961-c40d22edb62d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:12.039731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-48eed48a-ea44-440e-a961-c40d22edb62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:12.047687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 682/1362] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:12.093394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47cc5e-8f81-48eb-a5d4-04915f67857a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:12.118227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47cc5e-8f81-48eb-a5d4-04915f67857a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:12.125218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91addeb2-66f0-4a54-bb3a-92ea359d6a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:12.126147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91addeb2-66f0-4a54-bb3a-92ea359d6a1a service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:12.126855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91addeb2-66f0-4a54-bb3a-92ea359d6a1a service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:12.127346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91addeb2-66f0-4a54-bb3a-92ea359d6a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:12.137428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91addeb2-66f0-4a54-bb3a-92ea359d6a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:12.139442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91addeb2-66f0-4a54-bb3a-92ea359d6a1a service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:12.151069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 681/1363] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:14.899763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b791d-c240-4bd1-80d0-daec530b2fce None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:14.900372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b791d-c240-4bd1-80d0-daec530b2fce None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:14.900372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b791d-c240-4bd1-80d0-daec530b2fce None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:14.901754 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 683/1364] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:14.907974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953f2c-b20b-43af-bce7-965565e61421 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:14.910692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953f2c-b20b-43af-bce7-965565e61421 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:14.910692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953f2c-b20b-43af-bce7-965565e61421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:14.937371 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-98953f2c-b20b-43af-bce7-965565e61421 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:14.939120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-98953f2c-b20b-43af-bce7-965565e61421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:14.950652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 682/1365] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:14.998278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74545-2e20-4dd4-92bc-ebcaf9abf1a7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:14.998619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74545-2e20-4dd4-92bc-ebcaf9abf1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:14.999018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74545-2e20-4dd4-92bc-ebcaf9abf1a7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:15.001014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 684/1366] 10.222.0.123 () {54 vars in 966 bytes} [Thu May 26 18:04:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 18:04:15.006328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43934-bdc4-4e6d-9654-cd0c97439dae None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:15.006614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43934-bdc4-4e6d-9654-cd0c97439dae None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:15.006909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43934-bdc4-4e6d-9654-cd0c97439dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:15.027738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-57e43934-bdc4-4e6d-9654-cd0c97439dae None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:15.028933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-57e43934-bdc4-4e6d-9654-cd0c97439dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:15.038770 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 683/1367] 10.222.0.123 () {58 vars in 1063 bytes} [Thu May 26 18:04:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:15.047624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74545-2e20-4dd4-92bc-ebcaf9abf1a7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:15.062250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74545-2e20-4dd4-92bc-ebcaf9abf1a7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:15.067537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcabd0-28a5-4d1d-9b19-640d34f36668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:15.068156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcabd0-28a5-4d1d-9b19-640d34f36668 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:15.068474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcabd0-28a5-4d1d-9b19-640d34f36668 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:15.068781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcabd0-28a5-4d1d-9b19-640d34f36668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:15.077107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcabd0-28a5-4d1d-9b19-640d34f36668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:15.078708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcabd0-28a5-4d1d-9b19-640d34f36668 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:15.088086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 685/1368] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:04:17.594544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57cae0-f01e-4b54-88c2-afb73dc2a908 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:17.595096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57cae0-f01e-4b54-88c2-afb73dc2a908 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:17.595096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57cae0-f01e-4b54-88c2-afb73dc2a908 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:17.596389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 684/1369] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:17.602132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124061-c298-464b-a5cf-32dc932b66e7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:17.602609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124061-c298-464b-a5cf-32dc932b66e7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:17.602901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124061-c298-464b-a5cf-32dc932b66e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:17.621214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2d124061-c298-464b-a5cf-32dc932b66e7 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:17.622400 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2d124061-c298-464b-a5cf-32dc932b66e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:17.630568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 686/1370] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:17.676172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57cae0-f01e-4b54-88c2-afb73dc2a908 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:17.692141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57cae0-f01e-4b54-88c2-afb73dc2a908 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:17.698332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129c876-5b70-40cc-9ea1-e289c19abafd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:17.699008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129c876-5b70-40cc-9ea1-e289c19abafd service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:17.699286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129c876-5b70-40cc-9ea1-e289c19abafd service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:17.699557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129c876-5b70-40cc-9ea1-e289c19abafd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:17.710074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129c876-5b70-40cc-9ea1-e289c19abafd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:17.711424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37608-ee3b-47c1-81c0-d048150e024b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:17.711687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129c876-5b70-40cc-9ea1-e289c19abafd service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:17.712164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37608-ee3b-47c1-81c0-d048150e024b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:17.712867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37608-ee3b-47c1-81c0-d048150e024b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:17.715145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 687/1371] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:17 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 18:04:17.722237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604be19-525d-436a-a6ff-1bb2e793d3b0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:17.722589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604be19-525d-436a-a6ff-1bb2e793d3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:17.723161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604be19-525d-436a-a6ff-1bb2e793d3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:17.724910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 685/1372] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:17.752980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a604be19-525d-436a-a6ff-1bb2e793d3b0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:17.754344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a604be19-525d-436a-a6ff-1bb2e793d3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:17.763367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 688/1373] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:18.076526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bbba8-72d2-49aa-97a4-e8208b3a68f7 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:18.076526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bbba8-72d2-49aa-97a4-e8208b3a68f7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:18.076526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bbba8-72d2-49aa-97a4-e8208b3a68f7 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:18.078945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 686/1374] 10.222.0.123 () {54 vars in 968 bytes} [Thu May 26 18:04:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:18.084638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd6b8-b8da-4eb7-ade8-09870b3737f6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:18.084967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd6b8-b8da-4eb7-ade8-09870b3737f6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:18.085188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd6b8-b8da-4eb7-ade8-09870b3737f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:18.136339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fe5fd6b8-b8da-4eb7-ade8-09870b3737f6 None None] MFA Rules not processed for user `425574d1c0a04fb29452e7f7d0b7d685`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:18.137525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fe5fd6b8-b8da-4eb7-ade8-09870b3737f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:18.201482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 689/1375] 10.222.0.123 () {58 vars in 1065 bytes} [Thu May 26 18:04:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:18.209185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bbba8-72d2-49aa-97a4-e8208b3a68f7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:18.221783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bbba8-72d2-49aa-97a4-e8208b3a68f7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:18.224155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d6edd-3a06-4ae2-8cd7-2721033f246f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:18.225093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d6edd-3a06-4ae2-8cd7-2721033f246f service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:18.225451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d6edd-3a06-4ae2-8cd7-2721033f246f service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:18.225793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d6edd-3a06-4ae2-8cd7-2721033f246f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:18.236271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d6edd-3a06-4ae2-8cd7-2721033f246f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:18.237840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d6edd-3a06-4ae2-8cd7-2721033f246f service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:18.248315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 687/1376] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:20.130589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d370-136b-4452-8bbb-f34990b204bb None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:20.131145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d370-136b-4452-8bbb-f34990b204bb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:20.131145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d370-136b-4452-8bbb-f34990b204bb None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:20.132619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 690/1377] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:20.138551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6dd7c-47eb-45b4-9cab-c774434a8eeb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:20.139740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6dd7c-47eb-45b4-9cab-c774434a8eeb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:20.139740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6dd7c-47eb-45b4-9cab-c774434a8eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:20.158497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5fa6dd7c-47eb-45b4-9cab-c774434a8eeb None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:20.159715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5fa6dd7c-47eb-45b4-9cab-c774434a8eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:20.167743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 688/1378] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:20.213267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d370-136b-4452-8bbb-f34990b204bb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:20.228030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d370-136b-4452-8bbb-f34990b204bb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:20.234144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0676e-4700-4b9d-a2b9-71c5e414b894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:20.234724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0676e-4700-4b9d-a2b9-71c5e414b894 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:20.235003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0676e-4700-4b9d-a2b9-71c5e414b894 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:20.235274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0676e-4700-4b9d-a2b9-71c5e414b894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:20.244725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0676e-4700-4b9d-a2b9-71c5e414b894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:20.246329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0676e-4700-4b9d-a2b9-71c5e414b894 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:20.257198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 691/1379] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:22.691222 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff719-903e-4b59-9980-bfa3b9c6e7e5 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:22.691744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff719-903e-4b59-9980-bfa3b9c6e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:22.691744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff719-903e-4b59-9980-bfa3b9c6e7e5 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:22.693381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 689/1380] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:22.698776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f97e-f528-47b2-8af1-0553b2d2cc7a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:22.699204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f97e-f528-47b2-8af1-0553b2d2cc7a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:22.699318 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f97e-f528-47b2-8af1-0553b2d2cc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:22.718631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3777f97e-f528-47b2-8af1-0553b2d2cc7a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:22.719822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3777f97e-f528-47b2-8af1-0553b2d2cc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:22.727815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 692/1381] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:22.773878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fff719-903e-4b59-9980-bfa3b9c6e7e5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:22.788513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fff719-903e-4b59-9980-bfa3b9c6e7e5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:22.793979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4f235-7f70-4eb1-b657-ab124b778d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:22.794705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4f235-7f70-4eb1-b657-ab124b778d1c service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:22.795057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4f235-7f70-4eb1-b657-ab124b778d1c service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:22.795981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4f235-7f70-4eb1-b657-ab124b778d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:22.804499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4f235-7f70-4eb1-b657-ab124b778d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:22.806076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4f235-7f70-4eb1-b657-ab124b778d1c service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:22.816331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 690/1382] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:25.257726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648d09-d71a-467c-88c9-797f2669608d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.258260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648d09-d71a-467c-88c9-797f2669608d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.258260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93648d09-d71a-467c-88c9-797f2669608d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.259619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 693/1383] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:25.266138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3228887-08b2-4e4d-a25e-f019e2f83caf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.266594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3228887-08b2-4e4d-a25e-f019e2f83caf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.266700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3228887-08b2-4e4d-a25e-f019e2f83caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.288508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b3228887-08b2-4e4d-a25e-f019e2f83caf None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:25.289897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b3228887-08b2-4e4d-a25e-f019e2f83caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:25.302787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 691/1384] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:25.348337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648d09-d71a-467c-88c9-797f2669608d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:25.363992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93648d09-d71a-467c-88c9-797f2669608d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:25.369854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab101-d851-4132-bdc1-805e5583abc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:25.370591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab101-d851-4132-bdc1-805e5583abc3 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:25.370995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab101-d851-4132-bdc1-805e5583abc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:25.371368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab101-d851-4132-bdc1-805e5583abc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:25.381179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab101-d851-4132-bdc1-805e5583abc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:25.382889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab101-d851-4132-bdc1-805e5583abc3 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:25.397814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 694/1385] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:27.668247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4751d1-d2ee-4f2d-a5df-614f7e310cb2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:27.668818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4751d1-d2ee-4f2d-a5df-614f7e310cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:27.668818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4751d1-d2ee-4f2d-a5df-614f7e310cb2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:27.670467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 692/1386] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:27.676015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ef9b-b57a-4b57-a464-eb95729093ae None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:27.676633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ef9b-b57a-4b57-a464-eb95729093ae None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:27.676633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ef9b-b57a-4b57-a464-eb95729093ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:27.695816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a045ef9b-b57a-4b57-a464-eb95729093ae None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:27.697098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a045ef9b-b57a-4b57-a464-eb95729093ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:27.706391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 695/1387] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:27.754702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4751d1-d2ee-4f2d-a5df-614f7e310cb2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:27.774003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4751d1-d2ee-4f2d-a5df-614f7e310cb2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:27.781537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dd9e2-934b-452d-86fa-1168d90005b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:27.782346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dd9e2-934b-452d-86fa-1168d90005b1 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:27.782695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dd9e2-934b-452d-86fa-1168d90005b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:27.783043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dd9e2-934b-452d-86fa-1168d90005b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:27.795545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dd9e2-934b-452d-86fa-1168d90005b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:27.797587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dd9e2-934b-452d-86fa-1168d90005b1 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:27.811408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 693/1388] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:30.573098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a008-dc22-461a-840b-e788bf5894ae None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:30.573660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a008-dc22-461a-840b-e788bf5894ae None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:30.573825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a008-dc22-461a-840b-e788bf5894ae None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:30.575381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 696/1389] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:30.582523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18fb74-0ce3-47d0-bae1-b478230ed51d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:30.583335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18fb74-0ce3-47d0-bae1-b478230ed51d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:30.583632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18fb74-0ce3-47d0-bae1-b478230ed51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:30.602023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-de18fb74-0ce3-47d0-bae1-b478230ed51d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:30.603243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-de18fb74-0ce3-47d0-bae1-b478230ed51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:30.611225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 694/1390] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:04:30.656592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a008-dc22-461a-840b-e788bf5894ae None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:30.671744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a008-dc22-461a-840b-e788bf5894ae None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:30.677322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06985647-e96c-4eb4-8cd4-5cb9d5db022b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:30.677989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985647-e96c-4eb4-8cd4-5cb9d5db022b service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:30.678281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985647-e96c-4eb4-8cd4-5cb9d5db022b service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:30.678562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985647-e96c-4eb4-8cd4-5cb9d5db022b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:30.688122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06985647-e96c-4eb4-8cd4-5cb9d5db022b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:30.689897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06985647-e96c-4eb4-8cd4-5cb9d5db022b service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:30.700150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 697/1391] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:33.129806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdbfc0-5ac0-4a3c-ba47-63f686d3fde1 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:33.130462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdbfc0-5ac0-4a3c-ba47-63f686d3fde1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:33.130462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdbfc0-5ac0-4a3c-ba47-63f686d3fde1 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:33.131711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 695/1392] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:33.136919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e729-2df6-407d-9cb1-2ca415753b31 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:33.137369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e729-2df6-407d-9cb1-2ca415753b31 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:33.137474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e729-2df6-407d-9cb1-2ca415753b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:33.155363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a625e729-2df6-407d-9cb1-2ca415753b31 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:33.156596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a625e729-2df6-407d-9cb1-2ca415753b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:33.164273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 698/1393] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:33.209092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdbfc0-5ac0-4a3c-ba47-63f686d3fde1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:33.223660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdbfc0-5ac0-4a3c-ba47-63f686d3fde1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:33.229377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75ee0-19c5-4dd4-98df-ac2fe0ac8722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:33.230014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75ee0-19c5-4dd4-98df-ac2fe0ac8722 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:33.230292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75ee0-19c5-4dd4-98df-ac2fe0ac8722 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:33.230564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75ee0-19c5-4dd4-98df-ac2fe0ac8722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:33.239645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a75ee0-19c5-4dd4-98df-ac2fe0ac8722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:33.241239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a75ee0-19c5-4dd4-98df-ac2fe0ac8722 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:33.251082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 696/1394] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:34.770573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72b31d-f277-4d62-bdf2-e7ce9ca967fc None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:34.771141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72b31d-f277-4d62-bdf2-e7ce9ca967fc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:34.771141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72b31d-f277-4d62-bdf2-e7ce9ca967fc None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:34.772538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 699/1395] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:34.778134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa132d4-6821-4c08-8a7f-e429d4b5c82c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:34.778548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa132d4-6821-4c08-8a7f-e429d4b5c82c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:34.779342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa132d4-6821-4c08-8a7f-e429d4b5c82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:34.797422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-efa132d4-6821-4c08-8a7f-e429d4b5c82c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:34.798603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-efa132d4-6821-4c08-8a7f-e429d4b5c82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:34.806178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 697/1396] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:34.863694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e56b-eabf-4e58-aed1-39b5385c927b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:34.863983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e56b-eabf-4e58-aed1-39b5385c927b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:34.864264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e56b-eabf-4e58-aed1-39b5385c927b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:34.865652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 700/1397] 10.222.0.123 () {54 vars in 967 bytes} [Thu May 26 18:04:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:34.870578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a186-634e-49bf-aa60-b18505f1d25c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:34.870869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a186-634e-49bf-aa60-b18505f1d25c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:34.871147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a186-634e-49bf-aa60-b18505f1d25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:34.920455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-98d4a186-634e-49bf-aa60-b18505f1d25c None None] MFA Rules not processed for user `43a2c87f8db748ba9264b141f059aab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:34.921668 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-98d4a186-634e-49bf-aa60-b18505f1d25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:34.978839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:34.985065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 698/1398] 10.222.0.123 () {58 vars in 1064 bytes} [Thu May 26 18:04:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:34.992963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e56b-eabf-4e58-aed1-39b5385c927b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:34.999019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=87 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:35.004883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e56b-eabf-4e58-aed1-39b5385c927b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:35.008288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04865d5c-98ce-466d-8e4b-3ccb6df761c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a2c87f8db748ba9264b141f059aab9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:35.008936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04865d5c-98ce-466d-8e4b-3ccb6df761c3 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:35.009213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04865d5c-98ce-466d-8e4b-3ccb6df761c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:35.009485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04865d5c-98ce-466d-8e4b-3ccb6df761c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:35.018482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04865d5c-98ce-466d-8e4b-3ccb6df761c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:35.019908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04865d5c-98ce-466d-8e4b-3ccb6df761c3 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:35.031038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 701/1399] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:04:35.761395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62418d0-0990-4c1c-b79e-7bfdaf160137 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:35.761678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62418d0-0990-4c1c-b79e-7bfdaf160137 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:35.761975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62418d0-0990-4c1c-b79e-7bfdaf160137 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:35.763710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 699/1400] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:35.766186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aaf3c-9ee5-4d0c-a1ce-5cee73cbbe1a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:35.766546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aaf3c-9ee5-4d0c-a1ce-5cee73cbbe1a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:35.766892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aaf3c-9ee5-4d0c-a1ce-5cee73cbbe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:35.768399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44a23-457b-4fd7-a96f-84c960bf1608 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:35.768685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44a23-457b-4fd7-a96f-84c960bf1608 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:35.768960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44a23-457b-4fd7-a96f-84c960bf1608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:35.787052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e9c44a23-457b-4fd7-a96f-84c960bf1608 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:35.788271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e9c44a23-457b-4fd7-a96f-84c960bf1608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:35.797063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 700/1401] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:04:35.817601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-504aaf3c-9ee5-4d0c-a1ce-5cee73cbbe1a None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:35.818726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-504aaf3c-9ee5-4d0c-a1ce-5cee73cbbe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:35.839933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c44a23-457b-4fd7-a96f-84c960bf1608 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:35.853004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c44a23-457b-4fd7-a96f-84c960bf1608 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:35.859369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ce20-ae47-488e-9b84-76138a26d398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:35.860032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ce20-ae47-488e-9b84-76138a26d398 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:35.860334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ce20-ae47-488e-9b84-76138a26d398 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:35.860605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ce20-ae47-488e-9b84-76138a26d398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:35.869266 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ce20-ae47-488e-9b84-76138a26d398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:35.870947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ce20-ae47-488e-9b84-76138a26d398 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:35.880586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 701/1402] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:04:35.883305 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 702/1403] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:04:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:04:35.926795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1ab1-103a-4d76-a22e-6262f21c7718 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:35.927086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1ab1-103a-4d76-a22e-6262f21c7718 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:35.927362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1ab1-103a-4d76-a22e-6262f21c7718 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:35.928886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 702/1404] 10.222.0.123 () {54 vars in 947 bytes} [Thu May 26 18:04:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:35.935764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f10b8d-1774-4133-b8b0-ef104ee4b899 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:35.935764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f10b8d-1774-4133-b8b0-ef104ee4b899 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:35.936430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f10b8d-1774-4133-b8b0-ef104ee4b899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:35.987121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-17f10b8d-1774-4133-b8b0-ef104ee4b899 None None] MFA Rules not processed for user `a2fbee9630954680bcec917996319e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:35.988353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-17f10b8d-1774-4133-b8b0-ef104ee4b899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:36.061436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 703/1405] 10.222.0.123 () {58 vars in 1044 bytes} [Thu May 26 18:04:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:04:36.072077 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1ab1-103a-4d76-a22e-6262f21c7718 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:36.087380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1ab1-103a-4d76-a22e-6262f21c7718 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:36.093031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd9559-7815-4284-b901-f3434ddef05e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:36.093699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd9559-7815-4284-b901-f3434ddef05e service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:36.093976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd9559-7815-4284-b901-f3434ddef05e service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:36.094245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd9559-7815-4284-b901-f3434ddef05e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:36.103608 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd9559-7815-4284-b901-f3434ddef05e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:36.105373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd9559-7815-4284-b901-f3434ddef05e service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:36.116583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 703/1406] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:04:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:04:38.276985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81530-e9cb-476d-a3e7-146881b429c9 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:38.276985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81530-e9cb-476d-a3e7-146881b429c9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:38.277638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd81530-e9cb-476d-a3e7-146881b429c9 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:38.280350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 704/1407] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:04:38 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:04:38.287105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b5919-3d28-4eea-961c-b5ba406b2ad8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:38.287615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b5919-3d28-4eea-961c-b5ba406b2ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:38.287754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b5919-3d28-4eea-961c-b5ba406b2ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:38.323070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-428b5919-3d28-4eea-961c-b5ba406b2ad8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:04:38.325018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-428b5919-3d28-4eea-961c-b5ba406b2ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:04:38.334408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 704/1408] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:04:38.391920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81530-e9cb-476d-a3e7-146881b429c9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:04:38.408701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd81530-e9cb-476d-a3e7-146881b429c9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:04:38.415569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f69897-d12a-48d7-a8c8-de4427c5437d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:04:38.416383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f69897-d12a-48d7-a8c8-de4427c5437d service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:04:38.416694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f69897-d12a-48d7-a8c8-de4427c5437d service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:04:38.417161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f69897-d12a-48d7-a8c8-de4427c5437d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:04:38.426894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f69897-d12a-48d7-a8c8-de4427c5437d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:04:38.428647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f69897-d12a-48d7-a8c8-de4427c5437d service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:04:38.443586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 705/1409] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:04:48.315155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=19 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:48.438778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:00.767141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d038e5-bcee-4b28-8883-b74b29efe840 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:00.767798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d038e5-bcee-4b28-8883-b74b29efe840 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:00.767798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d038e5-bcee-4b28-8883-b74b29efe840 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:00.769080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 705/1410] 10.222.0.123 () {54 vars in 923 bytes} [Thu May 26 18:05:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 18:05:00.774412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462a9b-ab29-4244-bc4a-6f34fba9b943 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:00.774891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462a9b-ab29-4244-bc4a-6f34fba9b943 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:00.775002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462a9b-ab29-4244-bc4a-6f34fba9b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:00.792775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fc462a9b-ab29-4244-bc4a-6f34fba9b943 None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:00.793947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fc462a9b-ab29-4244-bc4a-6f34fba9b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:00.802883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 706/1411] 10.222.0.123 () {58 vars in 1020 bytes} [Thu May 26 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:00.817212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad958-339e-4f45-88a1-c66feb73ea18 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:00.817492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad958-339e-4f45-88a1-c66feb73ea18 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:00.817764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad958-339e-4f45-88a1-c66feb73ea18 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:00.819139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 706/1412] 10.222.0.123 () {54 vars in 923 bytes} [Thu May 26 18:05:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:00.823708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7642-1775-410a-b78b-11da2c2c13a8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:00.824015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7642-1775-410a-b78b-11da2c2c13a8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:00.824290 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7642-1775-410a-b78b-11da2c2c13a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:00.842152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fc9c7642-1775-410a-b78b-11da2c2c13a8 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:00.843851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fc9c7642-1775-410a-b78b-11da2c2c13a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:00.852935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 707/1413] 10.222.0.123 () {58 vars in 1020 bytes} [Thu May 26 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:03.578932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba165-f7f6-4f1a-8fe2-5dfd23b82bad None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:03.579488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba165-f7f6-4f1a-8fe2-5dfd23b82bad None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:03.579488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba165-f7f6-4f1a-8fe2-5dfd23b82bad None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:03.580788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:03.586004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2ab4-e321-435e-a81a-7c05589ea042 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:03.586432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2ab4-e321-435e-a81a-7c05589ea042 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:03.586541 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2ab4-e321-435e-a81a-7c05589ea042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:03.604202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f77b2ab4-e321-435e-a81a-7c05589ea042 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:03.605421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f77b2ab4-e321-435e-a81a-7c05589ea042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:03.613696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:03.658007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ba165-f7f6-4f1a-8fe2-5dfd23b82bad None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:03.672580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ba165-f7f6-4f1a-8fe2-5dfd23b82bad None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:03.677928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e22fb-1feb-4890-ad87-2d653e17b684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:03.678557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e22fb-1feb-4890-ad87-2d653e17b684 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:03.678839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e22fb-1feb-4890-ad87-2d653e17b684 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:03.679112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e22fb-1feb-4890-ad87-2d653e17b684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:03.688364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e22fb-1feb-4890-ad87-2d653e17b684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:03.689976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e22fb-1feb-4890-ad87-2d653e17b684 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:03.699369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 708/1416] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:05:04.672385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc4b2-ebb6-4c03-842f-82bf42e01098 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:04.672961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc4b2-ebb6-4c03-842f-82bf42e01098 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:04.672961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc4b2-ebb6-4c03-842f-82bf42e01098 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:04.674282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:05:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:04.679182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988afe-0d65-44a6-bd5c-0a6f66d13026 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:04.679628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988afe-0d65-44a6-bd5c-0a6f66d13026 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:04.679743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988afe-0d65-44a6-bd5c-0a6f66d13026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:04.698045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c7988afe-0d65-44a6-bd5c-0a6f66d13026 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:04.699281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c7988afe-0d65-44a6-bd5c-0a6f66d13026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:04.707915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:04.866641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc4b2-ebb6-4c03-842f-82bf42e01098 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:04.881426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc4b2-ebb6-4c03-842f-82bf42e01098 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:04.886757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e12f85-ac30-4db3-a7a2-b4a39378433d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:04.887387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f85-ac30-4db3-a7a2-b4a39378433d service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:04.887671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f85-ac30-4db3-a7a2-b4a39378433d service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:04.887947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f85-ac30-4db3-a7a2-b4a39378433d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:04.896448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e12f85-ac30-4db3-a7a2-b4a39378433d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:04.898311 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e12f85-ac30-4db3-a7a2-b4a39378433d service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:04.908965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 710/1419] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:05.836364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa166aa-ffcc-4a82-942f-a644bf4e718a None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:05.836928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa166aa-ffcc-4a82-942f-a644bf4e718a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:05.836928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa166aa-ffcc-4a82-942f-a644bf4e718a None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:05.838267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:05:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:05.844133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4941-ee10-4db3-883f-52986a59edb3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:05.844592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4941-ee10-4db3-883f-52986a59edb3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:05.844713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4941-ee10-4db3-883f-52986a59edb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:05.863117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-36fd4941-ee10-4db3-883f-52986a59edb3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:05.864358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-36fd4941-ee10-4db3-883f-52986a59edb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:05.872662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:06.022529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa166aa-ffcc-4a82-942f-a644bf4e718a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:06.037799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa166aa-ffcc-4a82-942f-a644bf4e718a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:06.043182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fc9ee-b118-42d5-b7e2-3e06a7605340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:06.043826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc9ee-b118-42d5-b7e2-3e06a7605340 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:06.044142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc9ee-b118-42d5-b7e2-3e06a7605340 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:06.044454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc9ee-b118-42d5-b7e2-3e06a7605340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:06.053471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fc9ee-b118-42d5-b7e2-3e06a7605340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:06.055096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fc9ee-b118-42d5-b7e2-3e06a7605340 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:06.064651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 711/1422] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:06.983414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ad44-30ac-4037-882f-008d641e9240 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:06.983993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ad44-30ac-4037-882f-008d641e9240 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:06.983993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ad44-30ac-4037-882f-008d641e9240 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:06.985371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:05:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:06.990327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af33b4-620f-411d-b35d-f7bc0dc57df5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:06.990744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af33b4-620f-411d-b35d-f7bc0dc57df5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:06.990887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af33b4-620f-411d-b35d-f7bc0dc57df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:07.008781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c4af33b4-620f-411d-b35d-f7bc0dc57df5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:07.009958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c4af33b4-620f-411d-b35d-f7bc0dc57df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:07.018576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:07.170110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91ad44-30ac-4037-882f-008d641e9240 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:07.187875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91ad44-30ac-4037-882f-008d641e9240 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:07.193440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a1cb3-527d-4f9e-bf6a-50ba273214f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:07.194080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a1cb3-527d-4f9e-bf6a-50ba273214f1 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:07.194359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a1cb3-527d-4f9e-bf6a-50ba273214f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:07.194635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a1cb3-527d-4f9e-bf6a-50ba273214f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:07.203973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a1cb3-527d-4f9e-bf6a-50ba273214f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:07.205617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a1cb3-527d-4f9e-bf6a-50ba273214f1 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:07.215185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 713/1425] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:08.125574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32602d6-eda1-455c-a988-7f72644cc260 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:08.126141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32602d6-eda1-455c-a988-7f72644cc260 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:08.126141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32602d6-eda1-455c-a988-7f72644cc260 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:08.127550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:05:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:08.132437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5557e27-0476-4b39-8e2b-ee65712dbdcc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:08.132857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5557e27-0476-4b39-8e2b-ee65712dbdcc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:08.132985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5557e27-0476-4b39-8e2b-ee65712dbdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:08.151934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d5557e27-0476-4b39-8e2b-ee65712dbdcc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:08.153161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d5557e27-0476-4b39-8e2b-ee65712dbdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:08.161166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:08.311669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32602d6-eda1-455c-a988-7f72644cc260 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:08.325848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32602d6-eda1-455c-a988-7f72644cc260 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:08.331487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e841e-16d9-4d93-9582-d3876eeecb59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:08.332137 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e841e-16d9-4d93-9582-d3876eeecb59 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:08.332676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e841e-16d9-4d93-9582-d3876eeecb59 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:08.334485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e841e-16d9-4d93-9582-d3876eeecb59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:08.341330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e841e-16d9-4d93-9582-d3876eeecb59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:08.342981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e841e-16d9-4d93-9582-d3876eeecb59 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:08.352494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 714/1428] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:09.270367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13662d-34a2-4602-9101-13991a050099 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:09.270885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13662d-34a2-4602-9101-13991a050099 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:09.270885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13662d-34a2-4602-9101-13991a050099 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:09.272475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:05:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:09.277824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd26066-995f-4b5a-bb27-90c2a6c10931 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:09.278254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd26066-995f-4b5a-bb27-90c2a6c10931 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:09.278386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd26066-995f-4b5a-bb27-90c2a6c10931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:09.297385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9bd26066-995f-4b5a-bb27-90c2a6c10931 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:09.299006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9bd26066-995f-4b5a-bb27-90c2a6c10931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:09.307010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:09.457576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13662d-34a2-4602-9101-13991a050099 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:09.471815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13662d-34a2-4602-9101-13991a050099 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:09.479899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b9f1-1421-4fed-93f2-b87372b2c952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:09.480799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b9f1-1421-4fed-93f2-b87372b2c952 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:09.481207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b9f1-1421-4fed-93f2-b87372b2c952 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:09.481504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b9f1-1421-4fed-93f2-b87372b2c952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:09.490763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436b9f1-1421-4fed-93f2-b87372b2c952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:09.492402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436b9f1-1421-4fed-93f2-b87372b2c952 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:09.502433 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 716/1431] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:10.446161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966276-5d65-43f2-bc09-7bc5bc87679d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:10.446737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966276-5d65-43f2-bc09-7bc5bc87679d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:10.446737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966276-5d65-43f2-bc09-7bc5bc87679d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:10.447974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:05:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:10.452900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0c9f-dbe7-4d1e-9fe9-16c5b588cc32 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:10.453343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0c9f-dbe7-4d1e-9fe9-16c5b588cc32 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:10.453450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0c9f-dbe7-4d1e-9fe9-16c5b588cc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:10.472212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5eaf0c9f-dbe7-4d1e-9fe9-16c5b588cc32 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:10.473437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5eaf0c9f-dbe7-4d1e-9fe9-16c5b588cc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:10.481220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:10.634276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966276-5d65-43f2-bc09-7bc5bc87679d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:10.648828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966276-5d65-43f2-bc09-7bc5bc87679d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:10.654246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118424db-f295-46a1-bd85-3b277a7d6fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:10.654879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118424db-f295-46a1-bd85-3b277a7d6fb9 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:10.655161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118424db-f295-46a1-bd85-3b277a7d6fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:10.655441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118424db-f295-46a1-bd85-3b277a7d6fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:10.663690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118424db-f295-46a1-bd85-3b277a7d6fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:10.665302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118424db-f295-46a1-bd85-3b277a7d6fb9 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:10.675192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 717/1434] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:11.590194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be3564-cc8f-4697-b4e4-461dcb49c60e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:11.590749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be3564-cc8f-4697-b4e4-461dcb49c60e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:11.590749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be3564-cc8f-4697-b4e4-461dcb49c60e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:11.592734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:05:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:11.597770 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a290c39-3537-4e4e-8035-493fdc8b0766 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:11.598209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a290c39-3537-4e4e-8035-493fdc8b0766 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:11.598360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a290c39-3537-4e4e-8035-493fdc8b0766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:11.616164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3a290c39-3537-4e4e-8035-493fdc8b0766 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:11.617377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3a290c39-3537-4e4e-8035-493fdc8b0766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:11.625217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:11.775802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be3564-cc8f-4697-b4e4-461dcb49c60e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:11.790171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be3564-cc8f-4697-b4e4-461dcb49c60e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:11.795616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a3d2f-bf4d-46d3-bd75-fa8524469e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:11.796233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a3d2f-bf4d-46d3-bd75-fa8524469e0b service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:11.796536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a3d2f-bf4d-46d3-bd75-fa8524469e0b service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:11.796806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a3d2f-bf4d-46d3-bd75-fa8524469e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:11.804783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a3d2f-bf4d-46d3-bd75-fa8524469e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:11.806413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a3d2f-bf4d-46d3-bd75-fa8524469e0b service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:11.816208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 719/1437] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:12.742995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9411-bf3b-4d54-83f9-4a1ac171f5e5 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:12.743559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9411-bf3b-4d54-83f9-4a1ac171f5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:12.743559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9411-bf3b-4d54-83f9-4a1ac171f5e5 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:12.744949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:05:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:12.749839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82b79-3c64-4efd-9eea-34af9021c4c4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:12.750265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82b79-3c64-4efd-9eea-34af9021c4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:12.750421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82b79-3c64-4efd-9eea-34af9021c4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:12.768764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-78f82b79-3c64-4efd-9eea-34af9021c4c4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:12.769947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-78f82b79-3c64-4efd-9eea-34af9021c4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:12.777859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:12.933873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c9411-bf3b-4d54-83f9-4a1ac171f5e5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:12.948252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c9411-bf3b-4d54-83f9-4a1ac171f5e5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:12.954465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc1c40-db30-4f10-90c5-8f719e53f628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:12.955088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc1c40-db30-4f10-90c5-8f719e53f628 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:12.955365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc1c40-db30-4f10-90c5-8f719e53f628 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:12.955638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc1c40-db30-4f10-90c5-8f719e53f628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:12.963651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc1c40-db30-4f10-90c5-8f719e53f628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:12.965243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc1c40-db30-4f10-90c5-8f719e53f628 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:12.975210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 720/1440] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:15.074027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee11eb-3559-4e94-ad9f-20c2899793a7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:15.074642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee11eb-3559-4e94-ad9f-20c2899793a7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:15.074642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee11eb-3559-4e94-ad9f-20c2899793a7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:15.075933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:15.081949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417e671-9880-44eb-8a70-1615e96a0a97 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:15.082364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417e671-9880-44eb-8a70-1615e96a0a97 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:15.082525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417e671-9880-44eb-8a70-1615e96a0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:15.101048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a417e671-9880-44eb-8a70-1615e96a0a97 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:15.102242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a417e671-9880-44eb-8a70-1615e96a0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:15.110664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:15.149322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee11eb-3559-4e94-ad9f-20c2899793a7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:15.160791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee11eb-3559-4e94-ad9f-20c2899793a7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:15.164642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbeb17-e058-4ea6-b2b2-12194f4c4489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:15.165271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbeb17-e058-4ea6-b2b2-12194f4c4489 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:15.165554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbeb17-e058-4ea6-b2b2-12194f4c4489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:15.165827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbeb17-e058-4ea6-b2b2-12194f4c4489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:15.175593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbeb17-e058-4ea6-b2b2-12194f4c4489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:15.177057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbeb17-e058-4ea6-b2b2-12194f4c4489 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:15.187459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 722/1443] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:17.551885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a26a-7588-4b77-ad24-00b4dcfd32ba None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:17.552449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a26a-7588-4b77-ad24-00b4dcfd32ba None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:17.552449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a26a-7588-4b77-ad24-00b4dcfd32ba None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:17.559148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:17 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:17.565351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eabfb5-0ab8-4d9c-b3c3-34afa2d3c7d3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:17.565794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eabfb5-0ab8-4d9c-b3c3-34afa2d3c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:17.565906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eabfb5-0ab8-4d9c-b3c3-34afa2d3c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:17.584157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-36eabfb5-0ab8-4d9c-b3c3-34afa2d3c7d3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:17.585374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-36eabfb5-0ab8-4d9c-b3c3-34afa2d3c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:17.593909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:17.647410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a26a-7588-4b77-ad24-00b4dcfd32ba None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:17.659583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a26a-7588-4b77-ad24-00b4dcfd32ba None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:17.663164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970c836-cbfe-466f-a164-38c7069a18de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:17.663798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970c836-cbfe-466f-a164-38c7069a18de service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:17.664079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970c836-cbfe-466f-a164-38c7069a18de service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:17.664405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970c836-cbfe-466f-a164-38c7069a18de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:17.673659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970c836-cbfe-466f-a164-38c7069a18de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:17.675085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970c836-cbfe-466f-a164-38c7069a18de service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:17.684522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 723/1446] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:20.276128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344143-335f-4faa-9e29-065ca13c304b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:20.276775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344143-335f-4faa-9e29-065ca13c304b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:20.276775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344143-335f-4faa-9e29-065ca13c304b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:20.278344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:20.283854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f265406-f91a-4561-a8cb-6b1b7d9544df None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:20.284379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f265406-f91a-4561-a8cb-6b1b7d9544df None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:20.284488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f265406-f91a-4561-a8cb-6b1b7d9544df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:20.302711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6f265406-f91a-4561-a8cb-6b1b7d9544df None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:20.303977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6f265406-f91a-4561-a8cb-6b1b7d9544df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:20.312443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:20.350553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344143-335f-4faa-9e29-065ca13c304b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:20.362238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344143-335f-4faa-9e29-065ca13c304b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:20.365733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678247ac-7d21-4f3c-a342-8a1e98a95ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:20.366356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678247ac-7d21-4f3c-a342-8a1e98a95ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:20.366636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678247ac-7d21-4f3c-a342-8a1e98a95ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:20.366907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678247ac-7d21-4f3c-a342-8a1e98a95ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:20.376282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678247ac-7d21-4f3c-a342-8a1e98a95ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:20.377735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678247ac-7d21-4f3c-a342-8a1e98a95ad7 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:20.386992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 725/1449] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:22.732871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022bb69-63ba-43c5-89e6-3736a5972c92 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:22.733469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022bb69-63ba-43c5-89e6-3736a5972c92 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:22.733469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022bb69-63ba-43c5-89e6-3736a5972c92 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:22.734812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:22.740215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef786-302d-4e74-afad-f5e7de80081b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:22.740669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef786-302d-4e74-afad-f5e7de80081b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:22.740825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef786-302d-4e74-afad-f5e7de80081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:22.759149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-93fef786-302d-4e74-afad-f5e7de80081b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:22.760475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-93fef786-302d-4e74-afad-f5e7de80081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:22.768175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:22.807805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022bb69-63ba-43c5-89e6-3736a5972c92 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:22.819340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022bb69-63ba-43c5-89e6-3736a5972c92 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:22.822860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad280e-7c55-4e63-80cd-b3b19a150265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:22.823484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad280e-7c55-4e63-80cd-b3b19a150265 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:22.823761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad280e-7c55-4e63-80cd-b3b19a150265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:22.824029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad280e-7c55-4e63-80cd-b3b19a150265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:22.833298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad280e-7c55-4e63-80cd-b3b19a150265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:22.834712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad280e-7c55-4e63-80cd-b3b19a150265 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:22.844445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 726/1452] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:25.109512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be1d3-5763-42f3-9f4e-6e2b71212cf6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:25.110051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be1d3-5763-42f3-9f4e-6e2b71212cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:25.110051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be1d3-5763-42f3-9f4e-6e2b71212cf6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:25.111425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:25.116685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea74397-127d-4e5c-84ba-0a9129a367fd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:25.117088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea74397-127d-4e5c-84ba-0a9129a367fd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:25.117241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea74397-127d-4e5c-84ba-0a9129a367fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:25.135321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-fea74397-127d-4e5c-84ba-0a9129a367fd None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:25.136546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fea74397-127d-4e5c-84ba-0a9129a367fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:25.145357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:25.184176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be1d3-5763-42f3-9f4e-6e2b71212cf6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:25.195469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be1d3-5763-42f3-9f4e-6e2b71212cf6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:25.198986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9e62b-c652-4a25-aa8c-ffcb81f74644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:25.199617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9e62b-c652-4a25-aa8c-ffcb81f74644 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:25.199895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9e62b-c652-4a25-aa8c-ffcb81f74644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:25.200169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9e62b-c652-4a25-aa8c-ffcb81f74644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:25.210304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9e62b-c652-4a25-aa8c-ffcb81f74644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:25.211734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9e62b-c652-4a25-aa8c-ffcb81f74644 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:25.221676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 728/1455] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:27.510826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657aefc-6172-4df0-8bd0-e43aafc0babc None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:27.511411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657aefc-6172-4df0-8bd0-e43aafc0babc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:27.511411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657aefc-6172-4df0-8bd0-e43aafc0babc None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:27.512790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:27.517971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711034b-b9f2-4d0d-a773-93e929a04bd4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:27.518412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711034b-b9f2-4d0d-a773-93e929a04bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:27.518522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711034b-b9f2-4d0d-a773-93e929a04bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:27.536616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3711034b-b9f2-4d0d-a773-93e929a04bd4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:27.537790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3711034b-b9f2-4d0d-a773-93e929a04bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:27.546032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:27.582553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657aefc-6172-4df0-8bd0-e43aafc0babc None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:27.593729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657aefc-6172-4df0-8bd0-e43aafc0babc None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:27.597258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e0c3b-085a-4075-b097-1f28fa1ed9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:27.597885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e0c3b-085a-4075-b097-1f28fa1ed9ac service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:27.598166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e0c3b-085a-4075-b097-1f28fa1ed9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:27.598440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e0c3b-085a-4075-b097-1f28fa1ed9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:27.607899 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e0c3b-085a-4075-b097-1f28fa1ed9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:27.609396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e0c3b-085a-4075-b097-1f28fa1ed9ac service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:27.619013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 729/1458] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:29.913409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a105-9128-42b4-adf4-26aea2a3c053 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:29.913978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a105-9128-42b4-adf4-26aea2a3c053 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:29.913978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a105-9128-42b4-adf4-26aea2a3c053 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:29.915356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:29.921449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90ca9e-1ed1-4cb9-83a2-e04bef41aebd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:29.921873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90ca9e-1ed1-4cb9-83a2-e04bef41aebd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:29.921988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90ca9e-1ed1-4cb9-83a2-e04bef41aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:29.927941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=70 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:29.940259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5b90ca9e-1ed1-4cb9-83a2-e04bef41aebd None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:29.941497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5b90ca9e-1ed1-4cb9-83a2-e04bef41aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:29.949565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:29.987889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389a105-9128-42b4-adf4-26aea2a3c053 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:29.993397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=73 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:29.999345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389a105-9128-42b4-adf4-26aea2a3c053 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:30.003434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b937950-9aad-42d7-9e83-67489fdf0d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:30.003434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937950-9aad-42d7-9e83-67489fdf0d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:30.003716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937950-9aad-42d7-9e83-67489fdf0d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:30.003991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937950-9aad-42d7-9e83-67489fdf0d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:30.012768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b937950-9aad-42d7-9e83-67489fdf0d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:30.014210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b937950-9aad-42d7-9e83-67489fdf0d42 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:30.024917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 731/1461] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:32.271898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfdc7a-9f7f-4c59-81a4-60b14510f693 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.272448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfdc7a-9f7f-4c59-81a4-60b14510f693 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.272448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfdc7a-9f7f-4c59-81a4-60b14510f693 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.273826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:32.279487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4beae-7f59-49fc-b949-c2559355b5f8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.279926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4beae-7f59-49fc-b949-c2559355b5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.280034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4beae-7f59-49fc-b949-c2559355b5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.299019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-45d4beae-7f59-49fc-b949-c2559355b5f8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:32.300661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-45d4beae-7f59-49fc-b949-c2559355b5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:32.308028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:05:32.344947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfdc7a-9f7f-4c59-81a4-60b14510f693 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:32.355471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfdc7a-9f7f-4c59-81a4-60b14510f693 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:32.359728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695bfe2-d241-4b03-91e0-a75d52aeda09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:32.360391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695bfe2-d241-4b03-91e0-a75d52aeda09 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:32.360673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695bfe2-d241-4b03-91e0-a75d52aeda09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:32.360942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695bfe2-d241-4b03-91e0-a75d52aeda09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:32.370057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695bfe2-d241-4b03-91e0-a75d52aeda09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:32.371525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695bfe2-d241-4b03-91e0-a75d52aeda09 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:32.381741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 732/1464] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:34.645869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd908af-46d2-49b5-96b2-241b33d37c13 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:34.646695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd908af-46d2-49b5-96b2-241b33d37c13 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:34.646695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd908af-46d2-49b5-96b2-241b33d37c13 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:34.648036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:34.653308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55acac-61cc-480c-97d0-121bc63cacfe None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:34.653756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55acac-61cc-480c-97d0-121bc63cacfe None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:34.653897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55acac-61cc-480c-97d0-121bc63cacfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:34.671875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-df55acac-61cc-480c-97d0-121bc63cacfe None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:34.673103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-df55acac-61cc-480c-97d0-121bc63cacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:34.680706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:34.716787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd908af-46d2-49b5-96b2-241b33d37c13 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:34.727099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd908af-46d2-49b5-96b2-241b33d37c13 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:34.730449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08730607-261c-490a-8f87-1eb458ca18e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:34.731071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08730607-261c-490a-8f87-1eb458ca18e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:34.731870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08730607-261c-490a-8f87-1eb458ca18e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:34.732140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08730607-261c-490a-8f87-1eb458ca18e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:34.740848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08730607-261c-490a-8f87-1eb458ca18e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:34.742267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08730607-261c-490a-8f87-1eb458ca18e2 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:34.752187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 734/1467] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:36.970609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e8c7f-c0fe-4a2f-90cb-578aaec72241 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:36.971179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e8c7f-c0fe-4a2f-90cb-578aaec72241 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:36.971179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e8c7f-c0fe-4a2f-90cb-578aaec72241 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:36.972573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:05:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:05:36.977910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401b53-4f93-404d-be2e-13aa57181980 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:36.978310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401b53-4f93-404d-be2e-13aa57181980 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:36.978460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401b53-4f93-404d-be2e-13aa57181980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:36.996431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bf401b53-4f93-404d-be2e-13aa57181980 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:05:36.998202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bf401b53-4f93-404d-be2e-13aa57181980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:05:37.005840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:05:37.042414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e8c7f-c0fe-4a2f-90cb-578aaec72241 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:05:37.053676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e8c7f-c0fe-4a2f-90cb-578aaec72241 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:05:37.057128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed1cbe-7d3d-40ed-b528-9e289ac14a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:05:37.057751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1cbe-7d3d-40ed-b528-9e289ac14a6a service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:05:37.058029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1cbe-7d3d-40ed-b528-9e289ac14a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:05:37.058297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed1cbe-7d3d-40ed-b528-9e289ac14a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:05:37.067742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed1cbe-7d3d-40ed-b528-9e289ac14a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:05:37.070037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed1cbe-7d3d-40ed-b528-9e289ac14a6a service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:05:37.080281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 735/1470] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:05:46.991267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=17 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:47.076028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=17 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:10.814344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793f90-caff-4673-aaf3-d837f49c532f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:10.814919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793f90-caff-4673-aaf3-d837f49c532f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:10.814919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793f90-caff-4673-aaf3-d837f49c532f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:10.816154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 736/1471] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:06:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:06:10.821445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1448be-2d9b-4c0f-9735-48d5e8edcad8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:10.821895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1448be-2d9b-4c0f-9735-48d5e8edcad8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:10.822007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1448be-2d9b-4c0f-9735-48d5e8edcad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:10.840492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0b1448be-2d9b-4c0f-9735-48d5e8edcad8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:10.841674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0b1448be-2d9b-4c0f-9735-48d5e8edcad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:10.849305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 736/1472] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:10.898211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363d16a-6a54-4fd6-b2e1-c666bc947bbe None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:10.898211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363d16a-6a54-4fd6-b2e1-c666bc947bbe None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:10.898211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363d16a-6a54-4fd6-b2e1-c666bc947bbe None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:10.899196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 737/1473] 10.222.0.123 () {54 vars in 967 bytes} [Thu May 26 18:06:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:06:10.904818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f0d4-7e26-4cd1-91c7-104d9636a0d3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:10.905123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f0d4-7e26-4cd1-91c7-104d9636a0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:10.905394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724f0d4-7e26-4cd1-91c7-104d9636a0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:10.924327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b724f0d4-7e26-4cd1-91c7-104d9636a0d3 None None] MFA Rules not processed for user `43a2c87f8db748ba9264b141f059aab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:10.926064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b724f0d4-7e26-4cd1-91c7-104d9636a0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:10.932188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 737/1474] 10.222.0.123 () {58 vars in 1064 bytes} [Thu May 26 18:06:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:10.939742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363d16a-6a54-4fd6-b2e1-c666bc947bbe None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:10.950923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363d16a-6a54-4fd6-b2e1-c666bc947bbe None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:10.954644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa314b-aad9-4caa-b836-bf876022e328 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a2c87f8db748ba9264b141f059aab9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:10.955279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa314b-aad9-4caa-b836-bf876022e328 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:10.955577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa314b-aad9-4caa-b836-bf876022e328 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:10.955823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa314b-aad9-4caa-b836-bf876022e328 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:10.965911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa314b-aad9-4caa-b836-bf876022e328 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:10.967349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa314b-aad9-4caa-b836-bf876022e328 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:10.976766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 738/1475] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:13.318136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8700e-8cf3-4dd7-940d-f32d77d31171 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:13.318699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8700e-8cf3-4dd7-940d-f32d77d31171 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:13.318699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8700e-8cf3-4dd7-940d-f32d77d31171 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:13.320049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 738/1476] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:06:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:06:13.326400 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953c8ea-d482-4552-8833-73dbc00ab26e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:13.326974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953c8ea-d482-4552-8833-73dbc00ab26e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:13.326974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953c8ea-d482-4552-8833-73dbc00ab26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:13.345758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4953c8ea-d482-4552-8833-73dbc00ab26e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:13.346973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4953c8ea-d482-4552-8833-73dbc00ab26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:13.355465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 739/1477] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:13.378962 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8700e-8cf3-4dd7-940d-f32d77d31171 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:13.391776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8700e-8cf3-4dd7-940d-f32d77d31171 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:13.396508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e531971-b3ca-49f6-84ae-efb5aaea4c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:13.397173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e531971-b3ca-49f6-84ae-efb5aaea4c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:13.397450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e531971-b3ca-49f6-84ae-efb5aaea4c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:13.397721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e531971-b3ca-49f6-84ae-efb5aaea4c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:13.398453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e531971-b3ca-49f6-84ae-efb5aaea4c24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:13.400261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-7e531971-b3ca-49f6-84ae-efb5aaea4c24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:06:13.400261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: warnings.warn(msg) May 26 18:06:13.400261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: May 26 18:06:13.402068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e531971-b3ca-49f6-84ae-efb5aaea4c24 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:13.423318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 739/1478] 10.222.0.123 () {56 vars in 1113 bytes} [Thu May 26 18:06:13 2022] GET /identity/v3/projects => generated 2562 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:06:15.684179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb208ac-e0cb-47f0-8ab5-8c870ad27236 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:15.684740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb208ac-e0cb-47f0-8ab5-8c870ad27236 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:15.684740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb208ac-e0cb-47f0-8ab5-8c870ad27236 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:15.686052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 740/1479] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:06:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:06:15.691187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e357-5769-44c7-855a-beec9ad0cd93 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:15.691622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e357-5769-44c7-855a-beec9ad0cd93 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:15.691729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e357-5769-44c7-855a-beec9ad0cd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:15.709433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7621e357-5769-44c7-855a-beec9ad0cd93 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:15.710873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7621e357-5769-44c7-855a-beec9ad0cd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:15.719147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 740/1480] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:15.762075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb208ac-e0cb-47f0-8ab5-8c870ad27236 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:15.776988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb208ac-e0cb-47f0-8ab5-8c870ad27236 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:15.784178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8050d1-4b50-4e48-81a7-b3ed1ee2f1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:15.784178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8050d1-4b50-4e48-81a7-b3ed1ee2f1e3 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:15.784178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8050d1-4b50-4e48-81a7-b3ed1ee2f1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:15.784178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8050d1-4b50-4e48-81a7-b3ed1ee2f1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:15.792432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8050d1-4b50-4e48-81a7-b3ed1ee2f1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:15.794036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8050d1-4b50-4e48-81a7-b3ed1ee2f1e3 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:15.803291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 741/1481] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:18.215122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de709-7182-492b-805e-7a015b805cb2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:18.215718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de709-7182-492b-805e-7a015b805cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:18.215718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de709-7182-492b-805e-7a015b805cb2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:18.217098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 741/1482] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:06:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:06:18.222508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99576710-c16e-4cca-9ff9-428ca2f9240c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:18.232457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99576710-c16e-4cca-9ff9-428ca2f9240c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:18.232457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99576710-c16e-4cca-9ff9-428ca2f9240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:18.241094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-99576710-c16e-4cca-9ff9-428ca2f9240c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:18.242278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-99576710-c16e-4cca-9ff9-428ca2f9240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:18.250566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 742/1483] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:18.287143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498de709-7182-492b-805e-7a015b805cb2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:18.299523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498de709-7182-492b-805e-7a015b805cb2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:18.303212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fd13a-f62d-4d2c-a580-2d2f30d7f0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:18.303863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fd13a-f62d-4d2c-a580-2d2f30d7f0bd service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:18.304150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fd13a-f62d-4d2c-a580-2d2f30d7f0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:18.304454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fd13a-f62d-4d2c-a580-2d2f30d7f0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:18.314325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fd13a-f62d-4d2c-a580-2d2f30d7f0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:18.316515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fd13a-f62d-4d2c-a580-2d2f30d7f0bd service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:18.327010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 742/1484] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:06:20.609487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003236fb-87e0-448f-854b-15d0c7c11448 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:20.610061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003236fb-87e0-448f-854b-15d0c7c11448 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:20.610061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003236fb-87e0-448f-854b-15d0c7c11448 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:20.611451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 743/1485] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:06:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:06:20.616692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e5ec4-f7dc-4840-ac53-2fe0e12d27bd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:20.617115 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e5ec4-f7dc-4840-ac53-2fe0e12d27bd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:20.617231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e5ec4-f7dc-4840-ac53-2fe0e12d27bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:20.635000 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-236e5ec4-f7dc-4840-ac53-2fe0e12d27bd None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:20.636757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-236e5ec4-f7dc-4840-ac53-2fe0e12d27bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:20.644527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 743/1486] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:20.683066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003236fb-87e0-448f-854b-15d0c7c11448 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:20.693566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003236fb-87e0-448f-854b-15d0c7c11448 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:20.696968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a375a29-d787-4626-a705-08229590c9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:20.697587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375a29-d787-4626-a705-08229590c9bd service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:20.698447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375a29-d787-4626-a705-08229590c9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:20.698765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375a29-d787-4626-a705-08229590c9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:20.707626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375a29-d787-4626-a705-08229590c9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:20.709133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375a29-d787-4626-a705-08229590c9bd service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:20.718862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 744/1487] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:23.075144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954ba23-3e02-4b90-beef-c1a3c5e60403 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:23.075736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954ba23-3e02-4b90-beef-c1a3c5e60403 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:23.075736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954ba23-3e02-4b90-beef-c1a3c5e60403 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:23.077100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 744/1488] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:06:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:06:23.082736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9e30-9810-44f8-ba5d-bbcf497982b6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:23.083185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9e30-9810-44f8-ba5d-bbcf497982b6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:23.083287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9e30-9810-44f8-ba5d-bbcf497982b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:23.101217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8f0f9e30-9810-44f8-ba5d-bbcf497982b6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:23.102539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8f0f9e30-9810-44f8-ba5d-bbcf497982b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:23.110989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 745/1489] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:23.150709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954ba23-3e02-4b90-beef-c1a3c5e60403 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:23.161935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954ba23-3e02-4b90-beef-c1a3c5e60403 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:23.165416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea5f4c-47f2-4402-85d8-0a55bf4220ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:23.166039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5f4c-47f2-4402-85d8-0a55bf4220ca service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:23.166314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5f4c-47f2-4402-85d8-0a55bf4220ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:23.167152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5f4c-47f2-4402-85d8-0a55bf4220ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:23.175877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea5f4c-47f2-4402-85d8-0a55bf4220ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:23.177307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea5f4c-47f2-4402-85d8-0a55bf4220ca service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:23.186585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 745/1490] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:25.752752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af5f8-842d-4e16-9d54-65965ad7e1bf None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:25.753305 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af5f8-842d-4e16-9d54-65965ad7e1bf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:25.753305 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af5f8-842d-4e16-9d54-65965ad7e1bf None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:25.754659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 746/1491] 10.222.0.123 () {54 vars in 931 bytes} [Thu May 26 18:06:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:06:25.759777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49b57-6ab4-497e-9a50-5cd7fcbc3b46 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:25.761207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49b57-6ab4-497e-9a50-5cd7fcbc3b46 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:25.761207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b49b57-6ab4-497e-9a50-5cd7fcbc3b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:25.783457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-61b49b57-6ab4-497e-9a50-5cd7fcbc3b46 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:25.785016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-61b49b57-6ab4-497e-9a50-5cd7fcbc3b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:25.793302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 746/1492] 10.222.0.123 () {58 vars in 1028 bytes} [Thu May 26 18:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:06:25.831807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4af5f8-842d-4e16-9d54-65965ad7e1bf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:25.843450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4af5f8-842d-4e16-9d54-65965ad7e1bf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:25.847200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817b64c-47a5-49a2-b0f8-bc17460dff6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:25.847821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b64c-47a5-49a2-b0f8-bc17460dff6b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:25.848095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b64c-47a5-49a2-b0f8-bc17460dff6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:25.848400 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817b64c-47a5-49a2-b0f8-bc17460dff6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:25.857246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817b64c-47a5-49a2-b0f8-bc17460dff6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:25.858667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817b64c-47a5-49a2-b0f8-bc17460dff6b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:25.867745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 747/1493] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:06:35.777601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=33 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:35.863694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=33 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.817886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070913-6d0b-4f2c-aad4-0f8ad6a22895 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.818495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070913-6d0b-4f2c-aad4-0f8ad6a22895 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.818495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9070913-6d0b-4f2c-aad4-0f8ad6a22895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.837502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f9070913-6d0b-4f2c-aad4-0f8ad6a22895 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:18.838677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f9070913-6d0b-4f2c-aad4-0f8ad6a22895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:18.846333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 747/1494] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:18.855573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14354aa-cbcd-47c9-a6e1-609b24131511 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.856079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14354aa-cbcd-47c9-a6e1-609b24131511 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.856179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14354aa-cbcd-47c9-a6e1-609b24131511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.873924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d14354aa-cbcd-47c9-a6e1-609b24131511 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:18.875096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d14354aa-cbcd-47c9-a6e1-609b24131511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:18.883502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 748/1495] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:18.888253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9070913-6d0b-4f2c-aad4-0f8ad6a22895 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.898584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9070913-6d0b-4f2c-aad4-0f8ad6a22895 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.903208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.904057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.904368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.904644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.905357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:18.905669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.906762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:08:18.906762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: warnings.warn(msg) May 26 18:08:18.906762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: May 26 18:08:18.907651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:18.919140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 748/1496] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:18.927073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14354aa-cbcd-47c9-a6e1-609b24131511 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.936253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14354aa-cbcd-47c9-a6e1-609b24131511 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.940703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.941334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.941615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.941905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.942559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.944326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:08:18.944326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: warnings.warn(msg) May 26 18:08:18.944326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: May 26 18:08:18.946019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.053901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 749/1497] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:08:18 2022] POST /identity/v3/projects => generated 376 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:19.058422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.068786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d56a3e-11de-4c6a-b297-6437840fe25c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.130980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.131446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.131734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.132651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.133472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.134502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:08:19.134502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: warnings.warn(msg) May 26 18:08:19.134502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: May 26 18:08:19.135820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.390874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 749/1498] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:08:19 2022] POST /identity/v3/users => generated 289 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:19.394932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.405398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a135b8d-6547-4911-b3c2-a57af0290630 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.409865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.410517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.410794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.411065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.411786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.412831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:08:19.412831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: warnings.warn(msg) May 26 18:08:19.412831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: May 26 18:08:19.413722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.426445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 750/1499] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:19.432654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.442616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9349-1d6f-4f7b-8a3d-2c8b8c273525 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.448963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ff77-a3ee-4f6a-bcce-d94f2c6ec174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.450669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ff77-a3ee-4f6a-bcce-d94f2c6ec174 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.450669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ff77-a3ee-4f6a-bcce-d94f2c6ec174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.450669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ff77-a3ee-4f6a-bcce-d94f2c6ec174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.451069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0ff77-a3ee-4f6a-bcce-d94f2c6ec174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.452085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-f7f0ff77-a3ee-4f6a-bcce-d94f2c6ec174 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:08:19.452085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: warnings.warn(msg) May 26 18:08:19.452085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: May 26 18:08:19.453029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0ff77-a3ee-4f6a-bcce-d94f2c6ec174 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.466803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 750/1500] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:19.470875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.480822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552ca50-486f-4d0e-a4b6-ba4a3bf87d6e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.485741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844a3d-82f7-4c84-afe1-43f39ceb0126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.486612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844a3d-82f7-4c84-afe1-43f39ceb0126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.486885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844a3d-82f7-4c84-afe1-43f39ceb0126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.487153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844a3d-82f7-4c84-afe1-43f39ceb0126 admin admin] PATH_INFO: `/v3/projects/eb42b7904b1141e889b076a0db55e6d9/users/3430115af1c64015a84126c22bd968b1/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.502142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f844a3d-82f7-4c84-afe1-43f39ceb0126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb42b7904b1141e889b076a0db55e6d9, user_id=3430115af1c64015a84126c22bd968b1, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.503195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-4f844a3d-82f7-4c84-afe1-43f39ceb0126 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:08:19.503195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: warnings.warn(msg) May 26 18:08:19.503195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: May 26 18:08:19.505321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f844a3d-82f7-4c84-afe1-43f39ceb0126 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.584894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 751/1501] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:08:19 2022] PUT /identity/v3/projects/eb42b7904b1141e889b076a0db55e6d9/users/3430115af1c64015a84126c22bd968b1/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:19.596451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282324-e420-42cf-9b5d-a82c57a63359 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.596738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282324-e420-42cf-9b5d-a82c57a63359 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.597010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282324-e420-42cf-9b5d-a82c57a63359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.661610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9f282324-e420-42cf-9b5d-a82c57a63359 None None] MFA Rules not processed for user `3430115af1c64015a84126c22bd968b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:19.664217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9f282324-e420-42cf-9b5d-a82c57a63359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:19.732002 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 751/1502] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:08:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:19.746939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9669e-c916-42f2-b98c-01bd6ab814bf None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.747223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9669e-c916-42f2-b98c-01bd6ab814bf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.747500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9669e-c916-42f2-b98c-01bd6ab814bf None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.748908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 752/1503] 10.222.0.123 () {54 vars in 968 bytes} [Thu May 26 18:08:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:08:19.754038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456f14-ecfd-4685-a1b3-b25e248cfbae None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.754433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456f14-ecfd-4685-a1b3-b25e248cfbae None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.754809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456f14-ecfd-4685-a1b3-b25e248cfbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.774117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c3456f14-ecfd-4685-a1b3-b25e248cfbae None None] MFA Rules not processed for user `425574d1c0a04fb29452e7f7d0b7d685`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:19.775298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c3456f14-ecfd-4685-a1b3-b25e248cfbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:19.817908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.825529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 752/1504] 10.222.0.123 () {58 vars in 1065 bytes} [Thu May 26 18:08:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:08:19.833572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9669e-c916-42f2-b98c-01bd6ab814bf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.845155 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9669e-c916-42f2-b98c-01bd6ab814bf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.848980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2d4b4-9c82-4657-8b2b-3461ff71442b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.849595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2d4b4-9c82-4657-8b2b-3461ff71442b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.849870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2d4b4-9c82-4657-8b2b-3461ff71442b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.850136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2d4b4-9c82-4657-8b2b-3461ff71442b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.858916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2d4b4-9c82-4657-8b2b-3461ff71442b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.860361 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2d4b4-9c82-4657-8b2b-3461ff71442b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.869673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 753/1505] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:08:19.912067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0663293-79a0-47f9-99b5-1838faf855ab None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.912315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0663293-79a0-47f9-99b5-1838faf855ab None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.912605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0663293-79a0-47f9-99b5-1838faf855ab None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.914567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 753/1506] 10.222.0.123 () {52 vars in 834 bytes} [Thu May 26 18:08:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:08:19.918152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2d4b4-9c82-4657-8b2b-3461ff71442b service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.983852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2d4b4-9c82-4657-8b2b-3461ff71442b service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.988296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.989171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.989462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.989733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] PATH_INFO: `/v3/users/3430115af1c64015a84126c22bd968b1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.990905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3430115af1c64015a84126c22bd968b1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.992697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:08:19.992697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: warnings.warn(msg) May 26 18:08:19.992697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: May 26 18:08:19.993921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.173585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3430115af1c64015a84126c22bd968b1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:20.174221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3430115af1c64015a84126c22bd968b1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:20.174824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3430115af1c64015a84126c22bd968b1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:20.192749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3430115af1c64015a84126c22bd968b1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:20.204640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3430115af1c64015a84126c22bd968b1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:20.208564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.298575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 754/1507] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:08:19 2022] DELETE /identity/v3/users/3430115af1c64015a84126c22bd968b1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:20.303112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc788bf-1d45-4071-9474-2c11185b6503 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.308466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc788bf-1d45-4071-9474-2c11185b6503 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.308466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc788bf-1d45-4071-9474-2c11185b6503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.321638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cdc788bf-1d45-4071-9474-2c11185b6503 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:20.322830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cdc788bf-1d45-4071-9474-2c11185b6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:20.384546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 754/1508] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:08:20.394698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.396111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:20.455120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c781a8a-fd05-4f12-ae2e-bc167a914829 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.458657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84eae0-dd6c-405f-8981-b75714b7e639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.459299 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84eae0-dd6c-405f-8981-b75714b7e639 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.459576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84eae0-dd6c-405f-8981-b75714b7e639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.459849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84eae0-dd6c-405f-8981-b75714b7e639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.469890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84eae0-dd6c-405f-8981-b75714b7e639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.471321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84eae0-dd6c-405f-8981-b75714b7e639 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.481800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 755/1509] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:08:20.964702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc788bf-1d45-4071-9474-2c11185b6503 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.964702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cdc788bf-1d45-4071-9474-2c11185b6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:20.971045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc788bf-1d45-4071-9474-2c11185b6503 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.976930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.977814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.978097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.978374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] PATH_INFO: `/v3/projects/eb42b7904b1141e889b076a0db55e6d9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.979617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb42b7904b1141e889b076a0db55e6d9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.980680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:08:20.980680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: warnings.warn(msg) May 26 18:08:20.980680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: May 26 18:08:20.981889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.138995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb42b7904b1141e889b076a0db55e6d9', 'request_id': 'req-925700b0-07c4-4f99-a7b5-b764b2b38a70'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:21.224350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb42b7904b1141e889b076a0db55e6d9', 'request_id': 'req-925700b0-07c4-4f99-a7b5-b764b2b38a70'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:21.238597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb42b7904b1141e889b076a0db55e6d9', 'request_id': 'req-925700b0-07c4-4f99-a7b5-b764b2b38a70'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:21.250180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] The token cache is being invalidate because project eb42b7904b1141e889b076a0db55e6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:08:21.250466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:21.251123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-925700b0-07c4-4f99-a7b5-b764b2b38a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:08:21.252852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 755/1510] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:08:20 2022] DELETE /identity/v3/projects/eb42b7904b1141e889b076a0db55e6d9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:30.477509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.247243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:14.806176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0edf0-f7c5-4fb1-98e5-29716370b2ca None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:14.806778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0edf0-f7c5-4fb1-98e5-29716370b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:14.806778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0edf0-f7c5-4fb1-98e5-29716370b2ca None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:14.808094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:10:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:14.812907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9094c-947e-4b37-b285-ca29e63474d0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:14.813319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9094c-947e-4b37-b285-ca29e63474d0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:14.813533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9094c-947e-4b37-b285-ca29e63474d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:14.832499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-bba9094c-947e-4b37-b285-ca29e63474d0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:14.833681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bba9094c-947e-4b37-b285-ca29e63474d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:14.894938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:15.078381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0edf0-f7c5-4fb1-98e5-29716370b2ca None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:15.080280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d6c0edf0-f7c5-4fb1-98e5-29716370b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:15.155264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0edf0-f7c5-4fb1-98e5-29716370b2ca None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:15.160429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248738c-e6ea-4945-be27-43227060187c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:15.161062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248738c-e6ea-4945-be27-43227060187c service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.161339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248738c-e6ea-4945-be27-43227060187c service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.161608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248738c-e6ea-4945-be27-43227060187c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.169844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248738c-e6ea-4945-be27-43227060187c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:15.171319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248738c-e6ea-4945-be27-43227060187c service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:15.180531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 757/1513] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:15.494302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4506-6d84-498c-ae5a-0987de80491e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.494879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4506-6d84-498c-ae5a-0987de80491e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.495315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4506-6d84-498c-ae5a-0987de80491e None None] PATH_INFO: `/v3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.496747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 757/1514] 10.222.0.59 () {54 vars in 929 bytes} [Thu May 26 18:10:15 2022] GET /identity/v3 => generated 256 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:15.502951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306d63-e4f6-405c-9fcf-5ad84b3acf41 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:15.503304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306d63-e4f6-405c-9fcf-5ad84b3acf41 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:15.503671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306d63-e4f6-405c-9fcf-5ad84b3acf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:15.521809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a2306d63-e4f6-405c-9fcf-5ad84b3acf41 None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:15.522994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a2306d63-e4f6-405c-9fcf-5ad84b3acf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:15.587273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 758/1515] 10.222.0.59 () {58 vars in 1019 bytes} [Thu May 26 18:10:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:16.065153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4c0db-fa7c-4eb6-9e34-fbedfc6141f6 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:16.065689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4c0db-fa7c-4eb6-9e34-fbedfc6141f6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:16.065808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4c0db-fa7c-4eb6-9e34-fbedfc6141f6 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:16.067117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 758/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:10:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:16.071971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7665ec-7859-4f81-8d4e-1e5e404abd43 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:16.072426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7665ec-7859-4f81-8d4e-1e5e404abd43 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:16.072549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7665ec-7859-4f81-8d4e-1e5e404abd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:16.090769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1a7665ec-7859-4f81-8d4e-1e5e404abd43 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:16.092798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1a7665ec-7859-4f81-8d4e-1e5e404abd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:16.100548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 759/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:16.254412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4c0db-fa7c-4eb6-9e34-fbedfc6141f6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:16.269234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4c0db-fa7c-4eb6-9e34-fbedfc6141f6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:16.274436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20b748-4aa8-43a5-a881-40111fccfb53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:16.275053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b748-4aa8-43a5-a881-40111fccfb53 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:16.275576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b748-4aa8-43a5-a881-40111fccfb53 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:16.275910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b748-4aa8-43a5-a881-40111fccfb53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:16.285152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20b748-4aa8-43a5-a881-40111fccfb53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:16.286741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20b748-4aa8-43a5-a881-40111fccfb53 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:16.296559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 759/1518] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:19.788662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0cd9-301f-4638-96c1-e06e31e2d640 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.789191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0cd9-301f-4638-96c1-e06e31e2d640 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.789191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0cd9-301f-4638-96c1-e06e31e2d640 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.790544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 760/1519] 10.222.0.123 () {54 vars in 965 bytes} [Thu May 26 18:10:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:19.796055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff04a-8d2e-4c01-8337-78b10b8b8168 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.796641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff04a-8d2e-4c01-8337-78b10b8b8168 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.796641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff04a-8d2e-4c01-8337-78b10b8b8168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.815569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6d9ff04a-8d2e-4c01-8337-78b10b8b8168 None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:19.816807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6d9ff04a-8d2e-4c01-8337-78b10b8b8168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:19.825816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 760/1520] 10.222.0.123 () {58 vars in 1062 bytes} [Thu May 26 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:19.833408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f0cd9-301f-4638-96c1-e06e31e2d640 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:19.846974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f0cd9-301f-4638-96c1-e06e31e2d640 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:19.851887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4d513-e7ac-4898-8425-c9a18722c897 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:19.852548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4d513-e7ac-4898-8425-c9a18722c897 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:19.852825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4d513-e7ac-4898-8425-c9a18722c897 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:19.853098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4d513-e7ac-4898-8425-c9a18722c897 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:19.861992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4d513-e7ac-4898-8425-c9a18722c897 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:19.863581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4d513-e7ac-4898-8425-c9a18722c897 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:19.873646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 761/1521] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:27.577953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aa0a7-a5db-449c-a344-7ac817c53a59 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:27.578521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aa0a7-a5db-449c-a344-7ac817c53a59 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:27.578521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aa0a7-a5db-449c-a344-7ac817c53a59 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:27.579827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:10:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:27.584654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d8e34-6531-429b-b13d-33f792e2bbd1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:27.585072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d8e34-6531-429b-b13d-33f792e2bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:27.585204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d8e34-6531-429b-b13d-33f792e2bbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:27.603269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-978d8e34-6531-429b-b13d-33f792e2bbd1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:27.604490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-978d8e34-6531-429b-b13d-33f792e2bbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:27.613230 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:27.773386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017aa0a7-a5db-449c-a344-7ac817c53a59 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:27.796236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017aa0a7-a5db-449c-a344-7ac817c53a59 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:27.803498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1561a6b-e97c-42ad-86d6-b0234c2101ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:27.804213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561a6b-e97c-42ad-86d6-b0234c2101ce service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:27.804517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561a6b-e97c-42ad-86d6-b0234c2101ce service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:27.804787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561a6b-e97c-42ad-86d6-b0234c2101ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:27.821464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1561a6b-e97c-42ad-86d6-b0234c2101ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:27.823052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1561a6b-e97c-42ad-86d6-b0234c2101ce service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:27.832961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 762/1524] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:28.698643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f139-6f3e-4ccc-ba7c-f4f95cff1da3 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:28.699165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f139-6f3e-4ccc-ba7c-f4f95cff1da3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:28.699360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f139-6f3e-4ccc-ba7c-f4f95cff1da3 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:28.700794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:10:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:28.706259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98d82-4d57-48b7-8f4d-6eeeff34bcc7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:28.706735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98d82-4d57-48b7-8f4d-6eeeff34bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:28.706840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98d82-4d57-48b7-8f4d-6eeeff34bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:28.724902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-78c98d82-4d57-48b7-8f4d-6eeeff34bcc7 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:28.726081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-78c98d82-4d57-48b7-8f4d-6eeeff34bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:28.734644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:28.884262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097f139-6f3e-4ccc-ba7c-f4f95cff1da3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:28.898774 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097f139-6f3e-4ccc-ba7c-f4f95cff1da3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:28.904951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469eca3-2d1a-44dd-bae6-3b3e730a2e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:28.905782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469eca3-2d1a-44dd-bae6-3b3e730a2e43 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:28.906058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469eca3-2d1a-44dd-bae6-3b3e730a2e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:28.906333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469eca3-2d1a-44dd-bae6-3b3e730a2e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:28.914395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469eca3-2d1a-44dd-bae6-3b3e730a2e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:28.915988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469eca3-2d1a-44dd-bae6-3b3e730a2e43 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:28.925329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 764/1527] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:33.202486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee02b-f9da-4f18-82e8-f86c0f0c6a3a None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.203366 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee02b-f9da-4f18-82e8-f86c0f0c6a3a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.203650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee02b-f9da-4f18-82e8-f86c0f0c6a3a None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.205121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:10:33 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:33.211316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f376a-01f8-439e-9f36-fe01a009313e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.211754 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f376a-01f8-439e-9f36-fe01a009313e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.213849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f376a-01f8-439e-9f36-fe01a009313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.231845 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ec7f376a-01f8-439e-9f36-fe01a009313e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:33.236904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ec7f376a-01f8-439e-9f36-fe01a009313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:33.241490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:33.278880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ee02b-f9da-4f18-82e8-f86c0f0c6a3a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:33.281700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5e5ee02b-f9da-4f18-82e8-f86c0f0c6a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:33.341181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ee02b-f9da-4f18-82e8-f86c0f0c6a3a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:33.345469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fa1b3-dd82-4984-b39a-74f109209cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:33.346108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa1b3-dd82-4984-b39a-74f109209cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:33.346392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa1b3-dd82-4984-b39a-74f109209cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:33.346669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa1b3-dd82-4984-b39a-74f109209cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:33.355833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fa1b3-dd82-4984-b39a-74f109209cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:33.357298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fa1b3-dd82-4984-b39a-74f109209cdf service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:33.367001 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 765/1530] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:35.570543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c728f8-1310-43bf-9427-9c1dd9ef0042 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:35.571061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c728f8-1310-43bf-9427-9c1dd9ef0042 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:35.571061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c728f8-1310-43bf-9427-9c1dd9ef0042 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:35.572423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:10:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:35.578936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833cb11-abec-42b8-8b1a-30634c40ea4c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:35.579379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833cb11-abec-42b8-8b1a-30634c40ea4c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:35.579495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833cb11-abec-42b8-8b1a-30634c40ea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:35.598416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c833cb11-abec-42b8-8b1a-30634c40ea4c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:35.599625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c833cb11-abec-42b8-8b1a-30634c40ea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:35.607617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:35.645923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c728f8-1310-43bf-9427-9c1dd9ef0042 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:35.647617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-34c728f8-1310-43bf-9427-9c1dd9ef0042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:35.661445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c728f8-1310-43bf-9427-9c1dd9ef0042 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:35.664939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a648f52-8507-42d3-8864-29d67a539a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:35.665566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648f52-8507-42d3-8864-29d67a539a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:35.665849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648f52-8507-42d3-8864-29d67a539a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:35.666122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648f52-8507-42d3-8864-29d67a539a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:35.674923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a648f52-8507-42d3-8864-29d67a539a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:35.676391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a648f52-8507-42d3-8864-29d67a539a21 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:35.685751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 767/1533] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:39.738408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636f07-d062-467b-aac6-e55eecbda2f8 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:39.738976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636f07-d062-467b-aac6-e55eecbda2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:39.738976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636f07-d062-467b-aac6-e55eecbda2f8 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:39.740432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:10:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:39.745759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5a188-7960-43f0-bf98-04adb1a8c295 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:39.746155 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5a188-7960-43f0-bf98-04adb1a8c295 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:39.746302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5a188-7960-43f0-bf98-04adb1a8c295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:39.764850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ecc5a188-7960-43f0-bf98-04adb1a8c295 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:39.766019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ecc5a188-7960-43f0-bf98-04adb1a8c295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:39.773696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:40.043333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636f07-d062-467b-aac6-e55eecbda2f8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:40.045736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9e636f07-d062-467b-aac6-e55eecbda2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:40.102087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636f07-d062-467b-aac6-e55eecbda2f8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:40.105652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc9d0e-42cc-4057-9e9d-78b5a31a34e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:40.106289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9d0e-42cc-4057-9e9d-78b5a31a34e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:40.106570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9d0e-42cc-4057-9e9d-78b5a31a34e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:40.106846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9d0e-42cc-4057-9e9d-78b5a31a34e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:40.116547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc9d0e-42cc-4057-9e9d-78b5a31a34e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:40.117969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc9d0e-42cc-4057-9e9d-78b5a31a34e1 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:40.122888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:40.128186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 768/1536] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:42.363513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527b4c-3525-4180-8f9f-c105d5b31ed6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:42.364001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527b4c-3525-4180-8f9f-c105d5b31ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:42.364112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d527b4c-3525-4180-8f9f-c105d5b31ed6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:42.365518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:10:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:10:42.370928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692d67-5e1d-401a-9617-45c73037ef08 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:42.371392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692d67-5e1d-401a-9617-45c73037ef08 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:42.371488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692d67-5e1d-401a-9617-45c73037ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:42.391285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b0692d67-5e1d-401a-9617-45c73037ef08 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:42.392523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b0692d67-5e1d-401a-9617-45c73037ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:42.400269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:10:42.679617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d527b4c-3525-4180-8f9f-c105d5b31ed6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:42.681302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1d527b4c-3525-4180-8f9f-c105d5b31ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:42.689401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=94 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:42.695042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d527b4c-3525-4180-8f9f-c105d5b31ed6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:42.698585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c642e-501e-4754-a54a-3114f56128dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:42.705869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c642e-501e-4754-a54a-3114f56128dc service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:42.705869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c642e-501e-4754-a54a-3114f56128dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:42.705869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c642e-501e-4754-a54a-3114f56128dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:42.710107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c642e-501e-4754-a54a-3114f56128dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:42.711537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c642e-501e-4754-a54a-3114f56128dc service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:42.721001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 770/1539] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:10:52.384956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:52.734229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:17.968889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adce0-7295-4c15-92cf-3e26a697518c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:17.969527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adce0-7295-4c15-92cf-3e26a697518c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:17.969527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280adce0-7295-4c15-92cf-3e26a697518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.001958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-280adce0-7295-4c15-92cf-3e26a697518c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.003593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-280adce0-7295-4c15-92cf-3e26a697518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.013705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 770/1540] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.032751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c3fda-274a-424e-88de-98bd75b69e8e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.033360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c3fda-274a-424e-88de-98bd75b69e8e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.033360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c3fda-274a-424e-88de-98bd75b69e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.064355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c68c3fda-274a-424e-88de-98bd75b69e8e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.065980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c68c3fda-274a-424e-88de-98bd75b69e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.078571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 771/1541] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.085466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280adce0-7295-4c15-92cf-3e26a697518c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:18.103448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280adce0-7295-4c15-92cf-3e26a697518c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:18.113095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaba1c-ed25-4e32-abec-cee71f80b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:18.114099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaba1c-ed25-4e32-abec-cee71f80b832 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.114589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaba1c-ed25-4e32-abec-cee71f80b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.115081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaba1c-ed25-4e32-abec-cee71f80b832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.116866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaba1c-ed25-4e32-abec-cee71f80b832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:18.117399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaba1c-ed25-4e32-abec-cee71f80b832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:18.119235 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaba1c-ed25-4e32-abec-cee71f80b832 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:18.137826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 771/1542] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:18.152141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c3fda-274a-424e-88de-98bd75b69e8e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:18.167704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c3fda-274a-424e-88de-98bd75b69e8e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:18.176356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160ae03-de11-429f-b45b-751838b2c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:18.177092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ae03-de11-429f-b45b-751838b2c7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.177376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ae03-de11-429f-b45b-751838b2c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.177646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ae03-de11-429f-b45b-751838b2c7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.179108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ae03-de11-429f-b45b-751838b2c7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:18.181103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ae03-de11-429f-b45b-751838b2c7d3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:18.199486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66edfc-78b1-4902-9583-e36e023b657d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.200641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66edfc-78b1-4902-9583-e36e023b657d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.201144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66edfc-78b1-4902-9583-e36e023b657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.234163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dc66edfc-78b1-4902-9583-e36e023b657d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.236474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dc66edfc-78b1-4902-9583-e36e023b657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.256808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 772/1543] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.261645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90435eca-4679-4e54-a47d-3c93f47a4825 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.265822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90435eca-4679-4e54-a47d-3c93f47a4825 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.265822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90435eca-4679-4e54-a47d-3c93f47a4825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.318047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-90435eca-4679-4e54-a47d-3c93f47a4825 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.323314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-90435eca-4679-4e54-a47d-3c93f47a4825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.330373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 772/1544] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/projects => generated 390 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:18.332000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae7eae-29f0-49a5-adc0-0204501eaa50 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.332416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae7eae-29f0-49a5-adc0-0204501eaa50 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.332951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae7eae-29f0-49a5-adc0-0204501eaa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.342868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 773/1545] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:18.346176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90435eca-4679-4e54-a47d-3c93f47a4825 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:18.368716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90435eca-4679-4e54-a47d-3c93f47a4825 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:18.373661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b5ae7eae-29f0-49a5-adc0-0204501eaa50 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.375188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b5ae7eae-29f0-49a5-adc0-0204501eaa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.526003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 773/1546] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.528050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e085f-45d7-4327-b0c8-fd0ca0a925d6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.528524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e085f-45d7-4327-b0c8-fd0ca0a925d6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.528981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e085f-45d7-4327-b0c8-fd0ca0a925d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.567299 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fa0e085f-45d7-4327-b0c8-fd0ca0a925d6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.569952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fa0e085f-45d7-4327-b0c8-fd0ca0a925d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.577262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179fdea-cb2c-461f-9145-90d34b513527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:18.577981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179fdea-cb2c-461f-9145-90d34b513527 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.578270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179fdea-cb2c-461f-9145-90d34b513527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.578548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179fdea-cb2c-461f-9145-90d34b513527 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.579257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179fdea-cb2c-461f-9145-90d34b513527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:18.587647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 774/1547] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.589358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179fdea-cb2c-461f-9145-90d34b513527 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:18.589725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045af37-1d4d-4da4-b4a2-ae0909753499 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.590166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045af37-1d4d-4da4-b4a2-ae0909753499 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.590600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045af37-1d4d-4da4-b4a2-ae0909753499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.624762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8045af37-1d4d-4da4-b4a2-ae0909753499 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.626748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8045af37-1d4d-4da4-b4a2-ae0909753499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.640842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 775/1548] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.642051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045af37-1d4d-4da4-b4a2-ae0909753499 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:18.659805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045af37-1d4d-4da4-b4a2-ae0909753499 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:18.668619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:18.670920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.670920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.670920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.671928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:18.672428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:18.674191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:12:18.674191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: warnings.warn(msg) May 26 18:12:18.674191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: May 26 18:12:18.675762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:18.701666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 776/1549] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:18.703070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:18.713104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 774/1550] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/users => generated 296 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:18.714289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748920e-1f7d-4c2e-b9a5-5df21e66eaee None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.714577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748920e-1f7d-4c2e-b9a5-5df21e66eaee None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.714856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748920e-1f7d-4c2e-b9a5-5df21e66eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.723813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ac81a-5b9b-43a3-a93a-409e089c93bf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:18.732240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7dbf7-4b75-4a13-8d97-cea5f5f8e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:18.733308 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7dbf7-4b75-4a13-8d97-cea5f5f8e754 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.733797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7dbf7-4b75-4a13-8d97-cea5f5f8e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.734220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7dbf7-4b75-4a13-8d97-cea5f5f8e754 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.735407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7dbf7-4b75-4a13-8d97-cea5f5f8e754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:18.735965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7dbf7-4b75-4a13-8d97-cea5f5f8e754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:18.739049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7dbf7-4b75-4a13-8d97-cea5f5f8e754 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:18.739648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3748920e-1f7d-4c2e-b9a5-5df21e66eaee None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.741543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3748920e-1f7d-4c2e-b9a5-5df21e66eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.756204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 777/1552] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:18.757614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73f2e-6f7e-4299-8370-b2690bc8d8ee None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.757951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73f2e-6f7e-4299-8370-b2690bc8d8ee None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.758240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73f2e-6f7e-4299-8370-b2690bc8d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.759476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 775/1552] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.761138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748920e-1f7d-4c2e-b9a5-5df21e66eaee None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:18.777313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748920e-1f7d-4c2e-b9a5-5df21e66eaee None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:18.782520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caee121-95b1-437c-921e-a53c9153526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:18.783198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caee121-95b1-437c-921e-a53c9153526c admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.783495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caee121-95b1-437c-921e-a53c9153526c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.783773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caee121-95b1-437c-921e-a53c9153526c admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.784696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caee121-95b1-437c-921e-a53c9153526c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:18.785726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-1caee121-95b1-437c-921e-a53c9153526c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:12:18.785726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: warnings.warn(msg) May 26 18:12:18.785726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: May 26 18:12:18.786949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caee121-95b1-437c-921e-a53c9153526c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:18.789196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2bd73f2e-6f7e-4299-8370-b2690bc8d8ee None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.791608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2bd73f2e-6f7e-4299-8370-b2690bc8d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.808198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 778/1553] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.809915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd73f2e-6f7e-4299-8370-b2690bc8d8ee None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:18.824511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd73f2e-6f7e-4299-8370-b2690bc8d8ee None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:18.831088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dedf54-61df-43c4-8fa6-a0142e983273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:18.832054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dedf54-61df-43c4-8fa6-a0142e983273 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.832509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dedf54-61df-43c4-8fa6-a0142e983273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.832924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dedf54-61df-43c4-8fa6-a0142e983273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.834084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dedf54-61df-43c4-8fa6-a0142e983273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:18.836815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dedf54-61df-43c4-8fa6-a0142e983273 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:18.851192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 779/1554] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:18 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:18.852506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e67f5-6e7f-4929-ae6e-a289c49c8c99 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.852785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e67f5-6e7f-4929-ae6e-a289c49c8c99 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.853077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e67f5-6e7f-4929-ae6e-a289c49c8c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.872239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-748e67f5-6e7f-4929-ae6e-a289c49c8c99 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.877156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-748e67f5-6e7f-4929-ae6e-a289c49c8c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.881897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 780/1555] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.882666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e67f5-6e7f-4929-ae6e-a289c49c8c99 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:18.892338 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e67f5-6e7f-4929-ae6e-a289c49c8c99 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:18.897824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2be1-7c2f-44fa-82f8-792572235250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:18.898590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2be1-7c2f-44fa-82f8-792572235250 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.898863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2be1-7c2f-44fa-82f8-792572235250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.899144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2be1-7c2f-44fa-82f8-792572235250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.899830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2be1-7c2f-44fa-82f8-792572235250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:18.901853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2be1-7c2f-44fa-82f8-792572235250 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:18.906238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 776/1556] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/projects => generated 356 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:18.911605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b99034-2246-40b9-93ce-a853038d768e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.911605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b99034-2246-40b9-93ce-a853038d768e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.911605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b99034-2246-40b9-93ce-a853038d768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:18.931085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-39b99034-2246-40b9-93ce-a853038d768e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:18.932279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-39b99034-2246-40b9-93ce-a853038d768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:18.991200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 777/1557] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:18.992530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d31f29-db2a-4e2f-8baa-b714eb172a89 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:18.992824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d31f29-db2a-4e2f-8baa-b714eb172a89 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:18.993102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d31f29-db2a-4e2f-8baa-b714eb172a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.006987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 781/1558] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/projects => generated 386 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:19.009937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417199d-5683-4b5a-9578-6dd29ae7aafc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.012206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417199d-5683-4b5a-9578-6dd29ae7aafc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.012206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417199d-5683-4b5a-9578-6dd29ae7aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.012603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a6d31f29-db2a-4e2f-8baa-b714eb172a89 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:19.013090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a6d31f29-db2a-4e2f-8baa-b714eb172a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:19.032143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3417199d-5683-4b5a-9578-6dd29ae7aafc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:19.033323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3417199d-5683-4b5a-9578-6dd29ae7aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:19.039750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:19.088811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 778/1559] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:19.089076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:19.089285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d31f29-db2a-4e2f-8baa-b714eb172a89 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.103129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d31f29-db2a-4e2f-8baa-b714eb172a89 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.108473 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc755a-0e4a-46d3-82e9-7f58f26a8e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.109279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc755a-0e4a-46d3-82e9-7f58f26a8e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.109682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 782/1560] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:19.109872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc755a-0e4a-46d3-82e9-7f58f26a8e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.110229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc755a-0e4a-46d3-82e9-7f58f26a8e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.110519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417199d-5683-4b5a-9578-6dd29ae7aafc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.111364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc755a-0e4a-46d3-82e9-7f58f26a8e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:19.111776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc755a-0e4a-46d3-82e9-7f58f26a8e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.113571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc755a-0e4a-46d3-82e9-7f58f26a8e60 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.128151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417199d-5683-4b5a-9578-6dd29ae7aafc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.129098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 779/1561] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:19.130500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368ef7-249a-4b00-be3d-673a52e0640b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.141557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368ef7-249a-4b00-be3d-673a52e0640b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.141557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368ef7-249a-4b00-be3d-673a52e0640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.141924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8885563-ef60-4d86-bbca-c32588b78de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.141924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8885563-ef60-4d86-bbca-c32588b78de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.141924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8885563-ef60-4d86-bbca-c32588b78de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.141924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8885563-ef60-4d86-bbca-c32588b78de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.142543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8885563-ef60-4d86-bbca-c32588b78de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.142543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8885563-ef60-4d86-bbca-c32588b78de4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.152520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-77368ef7-249a-4b00-be3d-673a52e0640b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:19.154203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 783/1562] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:19.154879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8885563-ef60-4d86-bbca-c32588b78de4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.156993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-77368ef7-249a-4b00-be3d-673a52e0640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:19.166936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8885563-ef60-4d86-bbca-c32588b78de4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.169324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 780/1563] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:19.170586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77368ef7-249a-4b00-be3d-673a52e0640b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.175596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e490154-8d34-4e2a-a924-161e86ebbc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.176529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490154-8d34-4e2a-a924-161e86ebbc69 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.176805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490154-8d34-4e2a-a924-161e86ebbc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.177081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490154-8d34-4e2a-a924-161e86ebbc69 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.178741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e490154-8d34-4e2a-a924-161e86ebbc69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.180756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-4e490154-8d34-4e2a-a924-161e86ebbc69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:12:19.180756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: warnings.warn(msg) May 26 18:12:19.180756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: May 26 18:12:19.182201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e490154-8d34-4e2a-a924-161e86ebbc69 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.185817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77368ef7-249a-4b00-be3d-673a52e0640b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.191082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.191308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.191589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.191861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.192641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:19.192922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.195659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.207731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 781/1564] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:19.207731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.219032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47668faa-5ad5-430a-b474-6aac134264fb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.223874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eab7a8-d3b0-4b8b-b180-ecec4cc5cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.225124 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eab7a8-d3b0-4b8b-b180-ecec4cc5cc0d admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.225593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eab7a8-d3b0-4b8b-b180-ecec4cc5cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.225878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eab7a8-d3b0-4b8b-b180-ecec4cc5cc0d admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.226603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eab7a8-d3b0-4b8b-b180-ecec4cc5cc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.228577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eab7a8-d3b0-4b8b-b180-ecec4cc5cc0d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.286702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 784/1565] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/users => generated 279 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:19.288598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce531e49-0f79-4c6e-9b59-b3456ca82b6b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.288813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce531e49-0f79-4c6e-9b59-b3456ca82b6b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.289091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce531e49-0f79-4c6e-9b59-b3456ca82b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.308443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ce531e49-0f79-4c6e-9b59-b3456ca82b6b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:19.309651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ce531e49-0f79-4c6e-9b59-b3456ca82b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:19.317732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 785/1566] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:19.323188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa2a26-c009-4e2a-9338-5f04d5dfeefc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.323188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa2a26-c009-4e2a-9338-5f04d5dfeefc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.323188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa2a26-c009-4e2a-9338-5f04d5dfeefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.323676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 782/1567] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:19.323676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eab7a8-d3b0-4b8b-b180-ecec4cc5cc0d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.333659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eab7a8-d3b0-4b8b-b180-ecec4cc5cc0d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.339182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62dde8-4d48-40e0-af3a-e5cc1f268822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.339833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62dde8-4d48-40e0-af3a-e5cc1f268822 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.340114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62dde8-4d48-40e0-af3a-e5cc1f268822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.340421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62dde8-4d48-40e0-af3a-e5cc1f268822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.341112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62dde8-4d48-40e0-af3a-e5cc1f268822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.342670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3daa2a26-c009-4e2a-9338-5f04d5dfeefc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:19.343012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62dde8-4d48-40e0-af3a-e5cc1f268822 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.343858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3daa2a26-c009-4e2a-9338-5f04d5dfeefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:19.353420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 786/1568] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:19.354197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa2a26-c009-4e2a-9338-5f04d5dfeefc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.364486 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa2a26-c009-4e2a-9338-5f04d5dfeefc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.370662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e254edf-2568-4787-ae8a-0afad54ec9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.375088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254edf-2568-4787-ae8a-0afad54ec9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.375088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254edf-2568-4787-ae8a-0afad54ec9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.375088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254edf-2568-4787-ae8a-0afad54ec9c7 admin admin] PATH_INFO: `/v3/projects/7e572c2dccfb4d57a35e31cecd041e11/users/ebdb2f4338f842f19f1cba1be13597c5/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.389760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e254edf-2568-4787-ae8a-0afad54ec9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e572c2dccfb4d57a35e31cecd041e11, user_id=ebdb2f4338f842f19f1cba1be13597c5, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.392495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e254edf-2568-4787-ae8a-0afad54ec9c7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.429519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 783/1569] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/projects => generated 368 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:19.430944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62dde8-4d48-40e0-af3a-e5cc1f268822 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.493580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 787/1570] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:19 2022] PUT /identity/v3/projects/7e572c2dccfb4d57a35e31cecd041e11/users/ebdb2f4338f842f19f1cba1be13597c5/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:19.493989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62dde8-4d48-40e0-af3a-e5cc1f268822 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.494389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e254edf-2568-4787-ae8a-0afad54ec9c7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.561002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e254edf-2568-4787-ae8a-0afad54ec9c7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.562850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.563522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.563793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.564061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.564841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:19.565166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.565824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1ee33-aa00-4e21-951a-7f5314fcf6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.566578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ee33-aa00-4e21-951a-7f5314fcf6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.566774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.566932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ee33-aa00-4e21-951a-7f5314fcf6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.567127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ee33-aa00-4e21-951a-7f5314fcf6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.567814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1ee33-aa00-4e21-951a-7f5314fcf6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.570325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1ee33-aa00-4e21-951a-7f5314fcf6c0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.574627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:19.581444 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 784/1571] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:19.582520 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.595244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dcc2b-0ef4-4a35-baf9-436b4a861caf admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.599858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe48b9-b418-4fad-8a53-d18b81910425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.600542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe48b9-b418-4fad-8a53-d18b81910425 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.600823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe48b9-b418-4fad-8a53-d18b81910425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.601097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe48b9-b418-4fad-8a53-d18b81910425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.601812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe48b9-b418-4fad-8a53-d18b81910425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.603398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe48b9-b418-4fad-8a53-d18b81910425 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.613726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 785/1572] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:19.614516 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe48b9-b418-4fad-8a53-d18b81910425 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.625114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe48b9-b418-4fad-8a53-d18b81910425 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.629826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.630582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.630920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.631718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.632506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:19.632812 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.634398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.646641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 786/1573] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:19.647724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.657491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3673e-2652-43a1-8279-0145ca5c5227 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.662561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4567-0ece-4231-8842-36ef64e72148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.663297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4567-0ece-4231-8842-36ef64e72148 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.663565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4567-0ece-4231-8842-36ef64e72148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.663842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4567-0ece-4231-8842-36ef64e72148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.664666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed4567-0ece-4231-8842-36ef64e72148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.666284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed4567-0ece-4231-8842-36ef64e72148 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.676786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 787/1574] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:19.678206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4567-0ece-4231-8842-36ef64e72148 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.688049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4567-0ece-4231-8842-36ef64e72148 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.693149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f50cc-3e74-4a8e-b92b-f1374b08bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.694498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f50cc-3e74-4a8e-b92b-f1374b08bab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.694760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f50cc-3e74-4a8e-b92b-f1374b08bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.695030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f50cc-3e74-4a8e-b92b-f1374b08bab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.695746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f50cc-3e74-4a8e-b92b-f1374b08bab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:19.696049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f50cc-3e74-4a8e-b92b-f1374b08bab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.697719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f50cc-3e74-4a8e-b92b-f1374b08bab3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.709971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 788/1575] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/projects => generated 366 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:19.710166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 788/1576] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:19.714168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1ee33-aa00-4e21-951a-7f5314fcf6c0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.717430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09563-8934-450b-b803-ded83737ecff None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.717721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09563-8934-450b-b803-ded83737ecff None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.718177 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09563-8934-450b-b803-ded83737ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.737359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-44e09563-8934-450b-b803-ded83737ecff None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:19.739049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-44e09563-8934-450b-b803-ded83737ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:19.785969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1ee33-aa00-4e21-951a-7f5314fcf6c0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.790979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018ffc5-7dfe-4fa8-baff-50735205108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.791359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ffc5-7dfe-4fa8-baff-50735205108c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.791637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ffc5-7dfe-4fa8-baff-50735205108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.791907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018ffc5-7dfe-4fa8-baff-50735205108c admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.792679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018ffc5-7dfe-4fa8-baff-50735205108c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.794614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018ffc5-7dfe-4fa8-baff-50735205108c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.805468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:19.812083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 789/1577] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:19.812931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09563-8934-450b-b803-ded83737ecff None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.825777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09563-8934-450b-b803-ded83737ecff None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.830313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226628-45d0-4fae-a623-4415fccbb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.830987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226628-45d0-4fae-a623-4415fccbb530 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.831265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226628-45d0-4fae-a623-4415fccbb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.831540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226628-45d0-4fae-a623-4415fccbb530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.832252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226628-45d0-4fae-a623-4415fccbb530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.834205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226628-45d0-4fae-a623-4415fccbb530 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.897406 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 789/1578] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:19.898289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018ffc5-7dfe-4fa8-baff-50735205108c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.908185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018ffc5-7dfe-4fa8-baff-50735205108c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:19.912794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc459e7a-8e8f-4ba4-a7f0-6c39ed1bca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:19.913466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc459e7a-8e8f-4ba4-a7f0-6c39ed1bca77 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:19.913744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc459e7a-8e8f-4ba4-a7f0-6c39ed1bca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:19.914022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc459e7a-8e8f-4ba4-a7f0-6c39ed1bca77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:19.914770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc459e7a-8e8f-4ba4-a7f0-6c39ed1bca77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:19.916404 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc459e7a-8e8f-4ba4-a7f0-6c39ed1bca77 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:19.930212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 790/1579] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:19.933184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc459e7a-8e8f-4ba4-a7f0-6c39ed1bca77 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.933460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 790/1580] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/projects => generated 380 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:19.933699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226628-45d0-4fae-a623-4415fccbb530 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:19.945592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc459e7a-8e8f-4ba4-a7f0-6c39ed1bca77 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.002100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226628-45d0-4fae-a623-4415fccbb530 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.003992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7bdb-9258-404c-ac86-7335057f763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.004827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7bdb-9258-404c-ac86-7335057f763d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.005232 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7bdb-9258-404c-ac86-7335057f763d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.005622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7bdb-9258-404c-ac86-7335057f763d admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.007378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131760be-bcd0-429a-b5f3-d7b815e04265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.007770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d7bdb-9258-404c-ac86-7335057f763d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.008042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131760be-bcd0-429a-b5f3-d7b815e04265 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.008356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131760be-bcd0-429a-b5f3-d7b815e04265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.008637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131760be-bcd0-429a-b5f3-d7b815e04265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.009361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131760be-bcd0-429a-b5f3-d7b815e04265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.010364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d7bdb-9258-404c-ac86-7335057f763d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.010958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131760be-bcd0-429a-b5f3-d7b815e04265 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.021209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 791/1581] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:19 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:20.022948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131760be-bcd0-429a-b5f3-d7b815e04265 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.032866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131760be-bcd0-429a-b5f3-d7b815e04265 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.037535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0224f8-3d4b-4a74-aede-4370c020bb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.038328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0224f8-3d4b-4a74-aede-4370c020bb5c admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.038613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0224f8-3d4b-4a74-aede-4370c020bb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.038891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0224f8-3d4b-4a74-aede-4370c020bb5c admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.042173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0224f8-3d4b-4a74-aede-4370c020bb5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.042173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0224f8-3d4b-4a74-aede-4370c020bb5c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.117056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 791/1582] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:19 2022] POST /identity/v3/projects => generated 376 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:20.117969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7bdb-9258-404c-ac86-7335057f763d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.126977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 792/1583] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:20 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:20.127446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0224f8-3d4b-4a74-aede-4370c020bb5c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.137620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:20.188764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0224f8-3d4b-4a74-aede-4370c020bb5c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.189823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7bdb-9258-404c-ac86-7335057f763d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.195102 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e28c5-fdab-4525-9964-7a1188be639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.195761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e28c5-fdab-4525-9964-7a1188be639d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.196042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e28c5-fdab-4525-9964-7a1188be639d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.196355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e28c5-fdab-4525-9964-7a1188be639d admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.197035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e28c5-fdab-4525-9964-7a1188be639d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.199011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e28c5-fdab-4525-9964-7a1188be639d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.242679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5b7ca-87b2-4c82-a9d6-38c859d10c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.243369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5b7ca-87b2-4c82-a9d6-38c859d10c46 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.243649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5b7ca-87b2-4c82-a9d6-38c859d10c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.243923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5b7ca-87b2-4c82-a9d6-38c859d10c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.253222 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5b7ca-87b2-4c82-a9d6-38c859d10c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.254743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5b7ca-87b2-4c82-a9d6-38c859d10c46 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.265081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 793/1584] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:20.265875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5b7ca-87b2-4c82-a9d6-38c859d10c46 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.275674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5b7ca-87b2-4c82-a9d6-38c859d10c46 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.281322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b814e-c886-4bf7-981d-a9f38e40de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.282223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b814e-c886-4bf7-981d-a9f38e40de43 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.282542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b814e-c886-4bf7-981d-a9f38e40de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.282844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b814e-c886-4bf7-981d-a9f38e40de43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.283570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b814e-c886-4bf7-981d-a9f38e40de43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.285479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b814e-c886-4bf7-981d-a9f38e40de43 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.297482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 794/1585] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:20 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:20.298198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b814e-c886-4bf7-981d-a9f38e40de43 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.304913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 792/1586] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:20 2022] POST /identity/v3/projects => generated 394 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:20.306366 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e28c5-fdab-4525-9964-7a1188be639d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.309528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b814e-c886-4bf7-981d-a9f38e40de43 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.374307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:20.377961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18839e-b918-4b25-860c-fec5b359ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.378856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18839e-b918-4b25-860c-fec5b359ee56 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.379191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18839e-b918-4b25-860c-fec5b359ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.379623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e28c5-fdab-4525-9964-7a1188be639d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.379744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18839e-b918-4b25-860c-fec5b359ee56 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.380850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18839e-b918-4b25-860c-fec5b359ee56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.384508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18839e-b918-4b25-860c-fec5b359ee56 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.385345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0835f7-eab2-413e-9cb7-82c117f2cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.386241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0835f7-eab2-413e-9cb7-82c117f2cf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.386526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0835f7-eab2-413e-9cb7-82c117f2cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.386807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0835f7-eab2-413e-9cb7-82c117f2cf82 admin admin] PATH_INFO: `/v3/projects/1cb3d7826b1e42c794f565ea40fefc86/users/3b8e872b187a4d7f9e770dbd6ef89dbc/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.403100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0835f7-eab2-413e-9cb7-82c117f2cf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb3d7826b1e42c794f565ea40fefc86, user_id=3b8e872b187a4d7f9e770dbd6ef89dbc, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.406220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0835f7-eab2-413e-9cb7-82c117f2cf82 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.449901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 795/1587] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:20 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:20.450974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18839e-b918-4b25-860c-fec5b359ee56 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.462429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18839e-b918-4b25-860c-fec5b359ee56 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.467979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.468988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.470670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.470670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] PATH_INFO: `/v3/projects/058135db20b74c1887487e4368245e00/users/09ad128756994ea0b6333d0694b840b9/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.486607 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=058135db20b74c1887487e4368245e00, user_id=09ad128756994ea0b6333d0694b840b9, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.487787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:12:20.487787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: warnings.warn(msg) May 26 18:12:20.487787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: May 26 18:12:20.490003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.499339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 793/1588] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:20 2022] PUT /identity/v3/projects/1cb3d7826b1e42c794f565ea40fefc86/users/3b8e872b187a4d7f9e770dbd6ef89dbc/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:20.499496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0835f7-eab2-413e-9cb7-82c117f2cf82 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.564597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0835f7-eab2-413e-9cb7-82c117f2cf82 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.569717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c3aaf-04f1-4237-82eb-2c84d3b1a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.570380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3aaf-04f1-4237-82eb-2c84d3b1a2ee admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.570661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3aaf-04f1-4237-82eb-2c84d3b1a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.570933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3aaf-04f1-4237-82eb-2c84d3b1a2ee admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.571612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c3aaf-04f1-4237-82eb-2c84d3b1a2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.573590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c3aaf-04f1-4237-82eb-2c84d3b1a2ee admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.623437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 796/1589] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:20 2022] PUT /identity/v3/projects/058135db20b74c1887487e4368245e00/users/09ad128756994ea0b6333d0694b840b9/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:20.627016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.661808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:20.681521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 794/1590] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:20 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:20.682582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c3aaf-04f1-4237-82eb-2c84d3b1a2ee admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.692639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c3aaf-04f1-4237-82eb-2c84d3b1a2ee admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.719321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a253bb1-d421-41e1-add2-ecb2b875c913 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.726001 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4539-adbe-4d15-a079-5207938020f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.726678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4539-adbe-4d15-a079-5207938020f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.727083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4539-adbe-4d15-a079-5207938020f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.727478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4539-adbe-4d15-a079-5207938020f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.728211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4539-adbe-4d15-a079-5207938020f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.729978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af4539-adbe-4d15-a079-5207938020f2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.748446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 797/1591] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:20 2022] GET /identity/v3/roles => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:20.749307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4539-adbe-4d15-a079-5207938020f2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.759089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72384d68-841b-4c29-992f-b7122829c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.759816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72384d68-841b-4c29-992f-b7122829c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.760101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72384d68-841b-4c29-992f-b7122829c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.760428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72384d68-841b-4c29-992f-b7122829c7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.761159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72384d68-841b-4c29-992f-b7122829c7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.762032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4539-adbe-4d15-a079-5207938020f2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.764463 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72384d68-841b-4c29-992f-b7122829c7d3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.768531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8f54c-7d7a-4a0c-8b1d-309c089171c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8f54c-7d7a-4a0c-8b1d-309c089171c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8f54c-7d7a-4a0c-8b1d-309c089171c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8f54c-7d7a-4a0c-8b1d-309c089171c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.770748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8f54c-7d7a-4a0c-8b1d-309c089171c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.773432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8f54c-7d7a-4a0c-8b1d-309c089171c0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.774059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 795/1592] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:20 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:20.775024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72384d68-841b-4c29-992f-b7122829c7d3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.785724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72384d68-841b-4c29-992f-b7122829c7d3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.794605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05e780-4d32-460c-a302-234d92a22d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.794605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05e780-4d32-460c-a302-234d92a22d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.794605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05e780-4d32-460c-a302-234d92a22d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.794605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05e780-4d32-460c-a302-234d92a22d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.795344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05e780-4d32-460c-a302-234d92a22d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.797164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05e780-4d32-460c-a302-234d92a22d16 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.816761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 796/1593] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:20 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:20.816761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79658f-e8ae-41e9-b137-ae043645a108 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.816761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79658f-e8ae-41e9-b137-ae043645a108 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.816761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79658f-e8ae-41e9-b137-ae043645a108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.846449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0a79658f-e8ae-41e9-b137-ae043645a108 None None] MFA Rules not processed for user `3b8e872b187a4d7f9e770dbd6ef89dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:20.847669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0a79658f-e8ae-41e9-b137-ae043645a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:20.887759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 798/1594] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:20 2022] POST /identity/v3/users => generated 298 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:20.887759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6dc51-c6cc-4574-846b-4ff92f7fa23b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.889100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6dc51-c6cc-4574-846b-4ff92f7fa23b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.889711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6dc51-c6cc-4574-846b-4ff92f7fa23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.900454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:20.941265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e8f6dc51-c6cc-4574-846b-4ff92f7fa23b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:20.943029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e8f6dc51-c6cc-4574-846b-4ff92f7fa23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:20.953009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 797/1595] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:20.953527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 799/1596] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:20.953928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79658f-e8ae-41e9-b137-ae043645a108 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.955093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6dc51-c6cc-4574-846b-4ff92f7fa23b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:20.969059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6dc51-c6cc-4574-846b-4ff92f7fa23b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.973913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a954d74-82a8-4ce1-b64a-898c3d419175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.974627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954d74-82a8-4ce1-b64a-898c3d419175 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.975512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954d74-82a8-4ce1-b64a-898c3d419175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.975672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79658f-e8ae-41e9-b137-ae043645a108 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:20.976322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954d74-82a8-4ce1-b64a-898c3d419175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.977208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a954d74-82a8-4ce1-b64a-898c3d419175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.978820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a954d74-82a8-4ce1-b64a-898c3d419175 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.980703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad16bcc-4864-4ca0-b03c-9c1530d22307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:20.981366 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16bcc-4864-4ca0-b03c-9c1530d22307 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:20.981794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16bcc-4864-4ca0-b03c-9c1530d22307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:20.982083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16bcc-4864-4ca0-b03c-9c1530d22307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:20.982814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad16bcc-4864-4ca0-b03c-9c1530d22307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:20.984461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad16bcc-4864-4ca0-b03c-9c1530d22307 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:20.992085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 800/1597] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:20 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:20.992085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a954d74-82a8-4ce1-b64a-898c3d419175 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.007424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 798/1598] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:20 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:21.007424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad16bcc-4864-4ca0-b03c-9c1530d22307 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.007756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a954d74-82a8-4ce1-b64a-898c3d419175 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.007970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaff4a-45e7-4248-a3fb-297261868172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.008895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaff4a-45e7-4248-a3fb-297261868172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.009273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaff4a-45e7-4248-a3fb-297261868172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.009440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad16bcc-4864-4ca0-b03c-9c1530d22307 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.009594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaff4a-45e7-4248-a3fb-297261868172 admin admin] PATH_INFO: `/v3/projects/3889c734bb724a5aa665a4a6b8bfaa6b/users/b5f139f4070b4ad98c8db2b843282905/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.014089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f22836-f8c5-43d3-adf8-8ce66181dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.014741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22836-f8c5-43d3-adf8-8ce66181dd60 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.015025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22836-f8c5-43d3-adf8-8ce66181dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.015336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22836-f8c5-43d3-adf8-8ce66181dd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.016052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f22836-f8c5-43d3-adf8-8ce66181dd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.017719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f22836-f8c5-43d3-adf8-8ce66181dd60 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.025574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaff4a-45e7-4248-a3fb-297261868172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3889c734bb724a5aa665a4a6b8bfaa6b, user_id=b5f139f4070b4ad98c8db2b843282905, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.028284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaff4a-45e7-4248-a3fb-297261868172 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.032776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 799/1599] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:20 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:21.035353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f22836-f8c5-43d3-adf8-8ce66181dd60 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.052038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f22836-f8c5-43d3-adf8-8ce66181dd60 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.057851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2169c-40ec-4d39-9f71-b309adde435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.058705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2169c-40ec-4d39-9f71-b309adde435e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.059045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2169c-40ec-4d39-9f71-b309adde435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.059403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2169c-40ec-4d39-9f71-b309adde435e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.060369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2169c-40ec-4d39-9f71-b309adde435e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.065082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2169c-40ec-4d39-9f71-b309adde435e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.073306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 800/1600] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:21 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:21.074153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2169c-40ec-4d39-9f71-b309adde435e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.084898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2169c-40ec-4d39-9f71-b309adde435e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.089784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611eaee-48fe-43b3-b354-cc31efce076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.090452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611eaee-48fe-43b3-b354-cc31efce076d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.090733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611eaee-48fe-43b3-b354-cc31efce076d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.093723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611eaee-48fe-43b3-b354-cc31efce076d admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.093723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611eaee-48fe-43b3-b354-cc31efce076d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.093723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611eaee-48fe-43b3-b354-cc31efce076d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.119542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 801/1601] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:20 2022] PUT /identity/v3/projects/3889c734bb724a5aa665a4a6b8bfaa6b/users/b5f139f4070b4ad98c8db2b843282905/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:21.120699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaff4a-45e7-4248-a3fb-297261868172 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.171293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 801/1602] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:21 2022] POST /identity/v3/projects => generated 358 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:21.172244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611eaee-48fe-43b3-b354-cc31efce076d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.229535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaff4a-45e7-4248-a3fb-297261868172 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.261927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611eaee-48fe-43b3-b354-cc31efce076d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.268972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292bf6-7389-440a-bdac-8c01127f911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.269800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292bf6-7389-440a-bdac-8c01127f911b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.270086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292bf6-7389-440a-bdac-8c01127f911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.270481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292bf6-7389-440a-bdac-8c01127f911b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.272505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292bf6-7389-440a-bdac-8c01127f911b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.274268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292bf6-7389-440a-bdac-8c01127f911b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.292525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 802/1603] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:21 2022] GET /identity/v3/roles => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:21.293549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292bf6-7389-440a-bdac-8c01127f911b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.306916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292bf6-7389-440a-bdac-8c01127f911b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.312129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051ec46-1156-443d-80b7-b0b10036ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.313057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051ec46-1156-443d-80b7-b0b10036ed8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.313338 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051ec46-1156-443d-80b7-b0b10036ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.313620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051ec46-1156-443d-80b7-b0b10036ed8c admin admin] PATH_INFO: `/v3/projects/dd230cfc335346099c3bdd70232a3457/users/ed9d88ad93a04a24a699fc90189c084d/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.320120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f488a9-31ac-4936-9c7f-95bac6cd7521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.320802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f488a9-31ac-4936-9c7f-95bac6cd7521 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.321491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f488a9-31ac-4936-9c7f-95bac6cd7521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.321491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f488a9-31ac-4936-9c7f-95bac6cd7521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.330614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051ec46-1156-443d-80b7-b0b10036ed8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd230cfc335346099c3bdd70232a3457, user_id=ed9d88ad93a04a24a699fc90189c084d, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.332035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f488a9-31ac-4936-9c7f-95bac6cd7521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.333426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051ec46-1156-443d-80b7-b0b10036ed8c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.334021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f488a9-31ac-4936-9c7f-95bac6cd7521 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.345518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 802/1604] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:21.346341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f488a9-31ac-4936-9c7f-95bac6cd7521 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.356280 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f488a9-31ac-4936-9c7f-95bac6cd7521 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.361967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2cfba-b771-4ee9-9d3f-6f43dbcdc470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.362790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cfba-b771-4ee9-9d3f-6f43dbcdc470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.363069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cfba-b771-4ee9-9d3f-6f43dbcdc470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.363369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cfba-b771-4ee9-9d3f-6f43dbcdc470 admin admin] PATH_INFO: `/v3/projects/f410bf6db858457db5a8d60731e2a744/users/5a3cff65840a42d58952d7edbb56529f/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.378236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:21.382288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2cfba-b771-4ee9-9d3f-6f43dbcdc470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f410bf6db858457db5a8d60731e2a744, user_id=5a3cff65840a42d58952d7edbb56529f, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.385118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2cfba-b771-4ee9-9d3f-6f43dbcdc470 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.421812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 803/1605] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:21 2022] PUT /identity/v3/projects/dd230cfc335346099c3bdd70232a3457/users/ed9d88ad93a04a24a699fc90189c084d/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:21.422980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051ec46-1156-443d-80b7-b0b10036ed8c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.481212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 803/1606] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:21 2022] PUT /identity/v3/projects/f410bf6db858457db5a8d60731e2a744/users/5a3cff65840a42d58952d7edbb56529f/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:21.483710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a34563-e0b9-4f18-96ab-a7ce5f92a1e3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.483710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a34563-e0b9-4f18-96ab-a7ce5f92a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.484200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a34563-e0b9-4f18-96ab-a7ce5f92a1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.518876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051ec46-1156-443d-80b7-b0b10036ed8c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.524014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:21.524264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-89a34563-e0b9-4f18-96ab-a7ce5f92a1e3 None None] MFA Rules not processed for user `b5f139f4070b4ad98c8db2b843282905`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:21.526752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-89a34563-e0b9-4f18-96ab-a7ce5f92a1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:21.605886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc28b1-2424-4c49-9dad-9f5a578bf926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.606899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc28b1-2424-4c49-9dad-9f5a578bf926 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.607371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc28b1-2424-4c49-9dad-9f5a578bf926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.616247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc28b1-2424-4c49-9dad-9f5a578bf926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.616247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc28b1-2424-4c49-9dad-9f5a578bf926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.616247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc28b1-2424-4c49-9dad-9f5a578bf926 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.616729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 804/1607] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:21.616729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a34563-e0b9-4f18-96ab-a7ce5f92a1e3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.630290 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 804/1608] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:21 2022] GET /identity/v3/roles => generated 1427 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:21.632150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc28b1-2424-4c49-9dad-9f5a578bf926 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.636889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a34563-e0b9-4f18-96ab-a7ce5f92a1e3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.642086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f65178-8dbc-4b04-b47b-5f4653fe771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.642908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f65178-8dbc-4b04-b47b-5f4653fe771c admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.643055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f65178-8dbc-4b04-b47b-5f4653fe771c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.643445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f65178-8dbc-4b04-b47b-5f4653fe771c admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.644076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f65178-8dbc-4b04-b47b-5f4653fe771c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.646188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f65178-8dbc-4b04-b47b-5f4653fe771c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.649556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc28b1-2424-4c49-9dad-9f5a578bf926 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.656920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effe6c0-e499-4dfe-9355-0a39972a4017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.658175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe6c0-e499-4dfe-9355-0a39972a4017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.658530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe6c0-e499-4dfe-9355-0a39972a4017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.658872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe6c0-e499-4dfe-9355-0a39972a4017 admin admin] PATH_INFO: `/v3/projects/eb4abeb0c58a4a7fb8e649fc4e1700d9/users/8f6ed3b32bdc4cd49b17f2bac3731907/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.677083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effe6c0-e499-4dfe-9355-0a39972a4017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4abeb0c58a4a7fb8e649fc4e1700d9, user_id=8f6ed3b32bdc4cd49b17f2bac3731907, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.679645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effe6c0-e499-4dfe-9355-0a39972a4017 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.761440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 805/1609] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:21 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:21.764100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24847f-a98e-4720-b690-4922a0b94f4f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.764339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24847f-a98e-4720-b690-4922a0b94f4f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.764631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24847f-a98e-4720-b690-4922a0b94f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.808872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ad24847f-a98e-4720-b690-4922a0b94f4f None None] MFA Rules not processed for user `ed9d88ad93a04a24a699fc90189c084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:21.810225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ad24847f-a98e-4720-b690-4922a0b94f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:21.826493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 805/1610] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:21 2022] PUT /identity/v3/projects/eb4abeb0c58a4a7fb8e649fc4e1700d9/users/8f6ed3b32bdc4cd49b17f2bac3731907/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:21.828806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79754e-80af-4196-8be2-ab0a5acc376c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.829278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79754e-80af-4196-8be2-ab0a5acc376c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.829564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79754e-80af-4196-8be2-ab0a5acc376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.851288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7f79754e-80af-4196-8be2-ab0a5acc376c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:21.853003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7f79754e-80af-4196-8be2-ab0a5acc376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:21.911573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 806/1611] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:21.913786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24847f-a98e-4720-b690-4922a0b94f4f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.936086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 806/1612] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:21.936925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79754e-80af-4196-8be2-ab0a5acc376c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:21.949919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79754e-80af-4196-8be2-ab0a5acc376c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:21.956354 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73777637-4d66-40e5-8351-80e08a9cfcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:21.957801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73777637-4d66-40e5-8351-80e08a9cfcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:21.958369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73777637-4d66-40e5-8351-80e08a9cfcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:21.961653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73777637-4d66-40e5-8351-80e08a9cfcbb admin admin] PATH_INFO: `/v3/projects/68c2f73b1ecd47ee8e4d9245e9710c83/users/95a7cc3020514672a7ab872cfdeabef6/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:21.987146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73777637-4d66-40e5-8351-80e08a9cfcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c2f73b1ecd47ee8e4d9245e9710c83, user_id=95a7cc3020514672a7ab872cfdeabef6, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:21.992522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73777637-4d66-40e5-8351-80e08a9cfcbb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:21.997590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24847f-a98e-4720-b690-4922a0b94f4f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:22.002282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b705a-1b2b-49a1-844c-fc32768f87df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:22.003147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b705a-1b2b-49a1-844c-fc32768f87df service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.003540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b705a-1b2b-49a1-844c-fc32768f87df service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.008046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b705a-1b2b-49a1-844c-fc32768f87df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.013602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:22.083445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b705a-1b2b-49a1-844c-fc32768f87df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:22.085632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b705a-1b2b-49a1-844c-fc32768f87df service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:22.094867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 807/1613] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:22.095705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b705a-1b2b-49a1-844c-fc32768f87df service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:22.107237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b705a-1b2b-49a1-844c-fc32768f87df service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:22.118247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 807/1614] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:21 2022] PUT /identity/v3/projects/68c2f73b1ecd47ee8e4d9245e9710c83/users/95a7cc3020514672a7ab872cfdeabef6/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:22.124830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9624b-a3e4-4630-9170-fff6134a9ad1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.124830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9624b-a3e4-4630-9170-fff6134a9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.124830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9624b-a3e4-4630-9170-fff6134a9ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.125265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfa9f2-6fc6-4e98-a55b-c20e2d8ac18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:22.125265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfa9f2-6fc6-4e98-a55b-c20e2d8ac18a admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.125265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfa9f2-6fc6-4e98-a55b-c20e2d8ac18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.125265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfa9f2-6fc6-4e98-a55b-c20e2d8ac18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.125709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfa9f2-6fc6-4e98-a55b-c20e2d8ac18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:22.134044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfa9f2-6fc6-4e98-a55b-c20e2d8ac18a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:22.161924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-20f9624b-a3e4-4630-9170-fff6134a9ad1 None None] MFA Rules not processed for user `8f6ed3b32bdc4cd49b17f2bac3731907`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:22.163793 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-20f9624b-a3e4-4630-9170-fff6134a9ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:22.176405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 808/1615] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:22 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:22.179533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfa9f2-6fc6-4e98-a55b-c20e2d8ac18a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:22.203153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfa9f2-6fc6-4e98-a55b-c20e2d8ac18a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:22.255016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:22.290216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb32e96-62fb-4b04-bbd7-e62bfc8362e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:22.292386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32e96-62fb-4b04-bbd7-e62bfc8362e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.292976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32e96-62fb-4b04-bbd7-e62bfc8362e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.293467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32e96-62fb-4b04-bbd7-e62bfc8362e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.294810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb32e96-62fb-4b04-bbd7-e62bfc8362e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:22.297895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb32e96-62fb-4b04-bbd7-e62bfc8362e4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:22.307170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 808/1616] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:22.307170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9624b-a3e4-4630-9170-fff6134a9ad1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:22.411141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9624b-a3e4-4630-9170-fff6134a9ad1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:22.415804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288c8db-b23c-4673-bd3d-e9129c54cae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:22.416490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288c8db-b23c-4673-bd3d-e9129c54cae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.416779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288c8db-b23c-4673-bd3d-e9129c54cae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.417034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288c8db-b23c-4673-bd3d-e9129c54cae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.434761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288c8db-b23c-4673-bd3d-e9129c54cae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:22.437919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288c8db-b23c-4673-bd3d-e9129c54cae0 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:22.439155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 809/1617] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:22 2022] POST /identity/v3/projects => generated 362 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:22.441124 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2778dd-e18a-4d89-8f01-248933922e3d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.441467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2778dd-e18a-4d89-8f01-248933922e3d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.441742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2778dd-e18a-4d89-8f01-248933922e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.479362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-bb2778dd-e18a-4d89-8f01-248933922e3d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:22.482000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 809/1618] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:22.483123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288c8db-b23c-4673-bd3d-e9129c54cae0 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:22.487688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bb2778dd-e18a-4d89-8f01-248933922e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:22.512564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288c8db-b23c-4673-bd3d-e9129c54cae0 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:22.620669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5cc3-1ee7-4e40-a05e-7875e5ede84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:22.623187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5cc3-1ee7-4e40-a05e-7875e5ede84e admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.624364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5cc3-1ee7-4e40-a05e-7875e5ede84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.624873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5cc3-1ee7-4e40-a05e-7875e5ede84e admin admin] PATH_INFO: `/v3/projects/800366482449454884502e402ebd6edd/users/5c3b3048e3eb415cb1f362df1915aa73/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.648733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5cc3-1ee7-4e40-a05e-7875e5ede84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=800366482449454884502e402ebd6edd, user_id=5c3b3048e3eb415cb1f362df1915aa73, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:22.651606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 810/1619] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:22.651858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5cc3-1ee7-4e40-a05e-7875e5ede84e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:22.653091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81491a2-34c4-49f3-848d-b5d0107d79b6 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.653382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81491a2-34c4-49f3-848d-b5d0107d79b6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.653660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81491a2-34c4-49f3-848d-b5d0107d79b6 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.655038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 811/1620] 10.222.0.123 () {54 vars in 966 bytes} [Thu May 26 18:12:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:12:22.661232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81491a2-34c4-49f3-848d-b5d0107d79b6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:22.694646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81491a2-34c4-49f3-848d-b5d0107d79b6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:22.704287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3112-68a2-4f63-8b03-f030044cc843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:22.704989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3112-68a2-4f63-8b03-f030044cc843 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.705327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3112-68a2-4f63-8b03-f030044cc843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.705537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3112-68a2-4f63-8b03-f030044cc843 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.706234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c3112-68a2-4f63-8b03-f030044cc843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:22.713066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c3112-68a2-4f63-8b03-f030044cc843 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:22.768674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 810/1621] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:22 2022] PUT /identity/v3/projects/800366482449454884502e402ebd6edd/users/5c3b3048e3eb415cb1f362df1915aa73/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:22.768887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e6fe-c607-40a8-b33e-0ed6f8c26764 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:22.769074 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e6fe-c607-40a8-b33e-0ed6f8c26764 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:22.769993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262e6fe-c607-40a8-b33e-0ed6f8c26764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:22.793229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f262e6fe-c607-40a8-b33e-0ed6f8c26764 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:22.794481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f262e6fe-c607-40a8-b33e-0ed6f8c26764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:22.855841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 812/1622] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:22 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:22.857031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3112-68a2-4f63-8b03-f030044cc843 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:22.872286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:22.941518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 811/1623] 10.222.0.123 () {58 vars in 1063 bytes} [Thu May 26 18:12:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:22.941518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262e6fe-c607-40a8-b33e-0ed6f8c26764 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:23.001278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3112-68a2-4f63-8b03-f030044cc843 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:23.059141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338bfe0-744a-44e8-b19b-1286165ce273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:23.060406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338bfe0-744a-44e8-b19b-1286165ce273 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:23.060704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338bfe0-744a-44e8-b19b-1286165ce273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:23.060986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338bfe0-744a-44e8-b19b-1286165ce273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:23.071841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:23.077776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338bfe0-744a-44e8-b19b-1286165ce273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:23.077776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338bfe0-744a-44e8-b19b-1286165ce273 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:23.089749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262e6fe-c607-40a8-b33e-0ed6f8c26764 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:23.100569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 813/1624] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:23.101351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338bfe0-744a-44e8-b19b-1286165ce273 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:23.101906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a4d29-2e84-45a3-bfc9-fdc39423abcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:23.102865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a4d29-2e84-45a3-bfc9-fdc39423abcf admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:23.103153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a4d29-2e84-45a3-bfc9-fdc39423abcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:23.103427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a4d29-2e84-45a3-bfc9-fdc39423abcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:23.104163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a4d29-2e84-45a3-bfc9-fdc39423abcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:23.107190 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a4d29-2e84-45a3-bfc9-fdc39423abcf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:23.112643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338bfe0-744a-44e8-b19b-1286165ce273 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:23.119393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 812/1625] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:22 2022] GET /identity/v3/roles => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:23.120891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a4d29-2e84-45a3-bfc9-fdc39423abcf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:23.122712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d25ce-b0c4-4282-ae24-22c71f1355bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:23.124007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d25ce-b0c4-4282-ae24-22c71f1355bd admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:23.124333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d25ce-b0c4-4282-ae24-22c71f1355bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:23.124760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d25ce-b0c4-4282-ae24-22c71f1355bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:23.125521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d25ce-b0c4-4282-ae24-22c71f1355bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:23.128343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d25ce-b0c4-4282-ae24-22c71f1355bd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:23.150912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 814/1626] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:23 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:23.152338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d25ce-b0c4-4282-ae24-22c71f1355bd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:23.159530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a4d29-2e84-45a3-bfc9-fdc39423abcf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:23.169604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199894f-76ed-4335-89fc-c027a572f09d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:23.170329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199894f-76ed-4335-89fc-c027a572f09d service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:23.170616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199894f-76ed-4335-89fc-c027a572f09d service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:23.170896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199894f-76ed-4335-89fc-c027a572f09d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:23.186951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d25ce-b0c4-4282-ae24-22c71f1355bd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:23.199934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdb38f-cbc7-4455-9d01-b17e5cab1397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:23.201554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb38f-cbc7-4455-9d01-b17e5cab1397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:23.201768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb38f-cbc7-4455-9d01-b17e5cab1397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:23.202188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdb38f-cbc7-4455-9d01-b17e5cab1397 admin admin] PATH_INFO: `/v3/projects/800366482449454884502e402ebd6edd/users/5c3b3048e3eb415cb1f362df1915aa73/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:23.213429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdb38f-cbc7-4455-9d01-b17e5cab1397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=800366482449454884502e402ebd6edd, user_id=5c3b3048e3eb415cb1f362df1915aa73, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:23.225577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdb38f-cbc7-4455-9d01-b17e5cab1397 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:23.293754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 815/1627] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:23 2022] PUT /identity/v3/projects/800366482449454884502e402ebd6edd/users/5c3b3048e3eb415cb1f362df1915aa73/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:23.295666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdb38f-cbc7-4455-9d01-b17e5cab1397 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:23.310675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199894f-76ed-4335-89fc-c027a572f09d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:23.312801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199894f-76ed-4335-89fc-c027a572f09d service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:23.328386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 813/1628] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:23.330113 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc926-79e7-4619-9e44-59cdac848b63 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:23.330401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc926-79e7-4619-9e44-59cdac848b63 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:23.332515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc926-79e7-4619-9e44-59cdac848b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:23.402548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-881bc926-79e7-4619-9e44-59cdac848b63 None None] MFA Rules not processed for user `5c3b3048e3eb415cb1f362df1915aa73`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:23.403854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-881bc926-79e7-4619-9e44-59cdac848b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:23.518940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdb38f-cbc7-4455-9d01-b17e5cab1397 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:23.535197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dc4e4-c241-4013-b9c7-50079318dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:23.537855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dc4e4-c241-4013-b9c7-50079318dabf admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:23.538651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dc4e4-c241-4013-b9c7-50079318dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:23.538785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dc4e4-c241-4013-b9c7-50079318dabf admin admin] PATH_INFO: `/v3/projects/61058d35affb4070a76f02bc41f15659/users/1bd0c26ba4b24d7ab1f83cb17f1db467/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:23.590183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dc4e4-c241-4013-b9c7-50079318dabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=61058d35affb4070a76f02bc41f15659, user_id=1bd0c26ba4b24d7ab1f83cb17f1db467, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:23.598096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dc4e4-c241-4013-b9c7-50079318dabf admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:23.619172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 814/1629] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:23.633058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bc926-79e7-4619-9e44-59cdac848b63 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:23.731030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 816/1630] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:23 2022] PUT /identity/v3/projects/61058d35affb4070a76f02bc41f15659/users/1bd0c26ba4b24d7ab1f83cb17f1db467/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:23.737854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dc4e4-c241-4013-b9c7-50079318dabf admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:23.921599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bc926-79e7-4619-9e44-59cdac848b63 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:23.950833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:23.963364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dc4e4-c241-4013-b9c7-50079318dabf admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:23.976575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142c919-1405-4bb2-9691-4d10a2abbbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:23.979997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c919-1405-4bb2-9691-4d10a2abbbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:23.980816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c919-1405-4bb2-9691-4d10a2abbbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:23.987005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c919-1405-4bb2-9691-4d10a2abbbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:23.987005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142c919-1405-4bb2-9691-4d10a2abbbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:23.991946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142c919-1405-4bb2-9691-4d10a2abbbe3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:24.021248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 817/1631] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:23 2022] GET /identity/v3/roles => generated 1427 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:24.027308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142c919-1405-4bb2-9691-4d10a2abbbe3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:24.053475 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142c919-1405-4bb2-9691-4d10a2abbbe3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:24.060292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:24.066387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96b63c-82df-44d0-9db6-f79c17e6e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:24.069811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96b63c-82df-44d0-9db6-f79c17e6e773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:24.071449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96b63c-82df-44d0-9db6-f79c17e6e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:24.071841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96b63c-82df-44d0-9db6-f79c17e6e773 admin admin] PATH_INFO: `/v3/projects/61058d35affb4070a76f02bc41f15659/users/1bd0c26ba4b24d7ab1f83cb17f1db467/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:24.077201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96b63c-82df-44d0-9db6-f79c17e6e773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61058d35affb4070a76f02bc41f15659, user_id=1bd0c26ba4b24d7ab1f83cb17f1db467, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:24.085010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96b63c-82df-44d0-9db6-f79c17e6e773 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:24.113488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 818/1632] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:24 2022] PUT /identity/v3/projects/61058d35affb4070a76f02bc41f15659/users/1bd0c26ba4b24d7ab1f83cb17f1db467/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:24.130289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1c80f-f650-4e17-aed2-b6a134eb1f9d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:24.131699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1c80f-f650-4e17-aed2-b6a134eb1f9d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:24.132183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1c80f-f650-4e17-aed2-b6a134eb1f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:24.134038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0fd52-84d5-44ca-9846-9071e38a59a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:24.134997 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0fd52-84d5-44ca-9846-9071e38a59a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:24.135417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0fd52-84d5-44ca-9846-9071e38a59a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:24.135929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0fd52-84d5-44ca-9846-9071e38a59a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:24.198771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a8a1c80f-f650-4e17-aed2-b6a134eb1f9d None None] MFA Rules not processed for user `1bd0c26ba4b24d7ab1f83cb17f1db467`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:24.200294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a8a1c80f-f650-4e17-aed2-b6a134eb1f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:24.261572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0fd52-84d5-44ca-9846-9071e38a59a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:24.263103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0fd52-84d5-44ca-9846-9071e38a59a2 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:24.277228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 815/1633] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:24.515098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 819/1634] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:24.518024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0fd52-84d5-44ca-9846-9071e38a59a2 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:24.518024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0fd52-84d5-44ca-9846-9071e38a59a2 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:24.659747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777900b-09ba-4f2c-8872-456d2099210f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:24.660820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777900b-09ba-4f2c-8872-456d2099210f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:24.661301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777900b-09ba-4f2c-8872-456d2099210f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:24.661712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777900b-09ba-4f2c-8872-456d2099210f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:24.685828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777900b-09ba-4f2c-8872-456d2099210f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:24.700291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777900b-09ba-4f2c-8872-456d2099210f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:24.730283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1c80f-f650-4e17-aed2-b6a134eb1f9d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:24.744661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 816/1635] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:24.765590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1c80f-f650-4e17-aed2-b6a134eb1f9d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:24.773189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3238ac-ae8c-4ff3-aa06-f2ab9dbe046f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:24.773660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3238ac-ae8c-4ff3-aa06-f2ab9dbe046f service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:24.773932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3238ac-ae8c-4ff3-aa06-f2ab9dbe046f service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:24.774206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3238ac-ae8c-4ff3-aa06-f2ab9dbe046f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:24.851502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec409c55-0bdf-4288-b6f2-8fae6359da7d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:24.851783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec409c55-0bdf-4288-b6f2-8fae6359da7d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:24.852058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec409c55-0bdf-4288-b6f2-8fae6359da7d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:24.854114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 817/1636] 10.222.0.123 () {54 vars in 966 bytes} [Thu May 26 18:12:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:12:24.871007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e093-2873-41ef-9a1f-8319ff4d3a00 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:24.871303 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e093-2873-41ef-9a1f-8319ff4d3a00 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:24.871579 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e093-2873-41ef-9a1f-8319ff4d3a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:24.899022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b6e4e093-2873-41ef-9a1f-8319ff4d3a00 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:24.900508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b6e4e093-2873-41ef-9a1f-8319ff4d3a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:24.969461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:24.994129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3238ac-ae8c-4ff3-aa06-f2ab9dbe046f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:25.005155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3238ac-ae8c-4ff3-aa06-f2ab9dbe046f service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:25.037265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 820/1637] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:25.098214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 818/1638] 10.222.0.123 () {58 vars in 1063 bytes} [Thu May 26 18:12:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:25.105418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763d40-6671-4b5d-95ee-bace9d0df1c0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:25.106610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763d40-6671-4b5d-95ee-bace9d0df1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:25.107063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1763d40-6671-4b5d-95ee-bace9d0df1c0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:25.109155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 821/1639] 10.222.0.123 () {54 vars in 917 bytes} [Thu May 26 18:12:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:12:25.116792 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbdd5c-c8a8-4cf7-9cd9-3dcdb94347b1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:25.120500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbdd5c-c8a8-4cf7-9cd9-3dcdb94347b1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:25.122590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbdd5c-c8a8-4cf7-9cd9-3dcdb94347b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:25.160531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2ccbdd5c-c8a8-4cf7-9cd9-3dcdb94347b1 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:25.162246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2ccbdd5c-c8a8-4cf7-9cd9-3dcdb94347b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:25.166577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51a8b-a97f-4d55-808b-a77db6a86f57 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:25.166929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51a8b-a97f-4d55-808b-a77db6a86f57 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:25.167210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51a8b-a97f-4d55-808b-a77db6a86f57 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:25.169465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 822/1640] 10.222.0.123 () {54 vars in 917 bytes} [Thu May 26 18:12:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:12:25.176803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3f10-8e1a-42b5-a8c8-77cec70730a7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:25.177093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3f10-8e1a-42b5-a8c8-77cec70730a7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:25.177543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3f10-8e1a-42b5-a8c8-77cec70730a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:25.183925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 819/1641] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:12:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:25.210870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-142a3f10-8e1a-42b5-a8c8-77cec70730a7 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:25.212451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-142a3f10-8e1a-42b5-a8c8-77cec70730a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:25.227053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 823/1642] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:12:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:25.270270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbdd5c-c8a8-4cf7-9cd9-3dcdb94347b1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:25.293378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbdd5c-c8a8-4cf7-9cd9-3dcdb94347b1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:25.304818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516fdca-aafa-436c-a269-1a0f14de4dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:25.305749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fdca-aafa-436c-a269-1a0f14de4dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:25.306950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fdca-aafa-436c-a269-1a0f14de4dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:25.307660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fdca-aafa-436c-a269-1a0f14de4dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:25.332127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516fdca-aafa-436c-a269-1a0f14de4dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:25.337474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516fdca-aafa-436c-a269-1a0f14de4dc2 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:25.355481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 820/1643] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:25.398942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a3f10-8e1a-42b5-a8c8-77cec70730a7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:25.415286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a3f10-8e1a-42b5-a8c8-77cec70730a7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:25.425298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445bd5e-bd95-4b5c-9492-9edeba7044d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:25.425298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445bd5e-bd95-4b5c-9492-9edeba7044d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:25.425298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445bd5e-bd95-4b5c-9492-9edeba7044d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:25.425298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445bd5e-bd95-4b5c-9492-9edeba7044d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:25.437271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445bd5e-bd95-4b5c-9492-9edeba7044d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:25.439182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445bd5e-bd95-4b5c-9492-9edeba7044d4 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:25.471676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 824/1644] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:25.723117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055806-fffd-417a-b1f0-54638d0050c7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:25.724089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055806-fffd-417a-b1f0-54638d0050c7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:25.724532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055806-fffd-417a-b1f0-54638d0050c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:25.805587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b4055806-fffd-417a-b1f0-54638d0050c7 None None] MFA Rules not processed for user `5a3cff65840a42d58952d7edbb56529f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:25.809189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b4055806-fffd-417a-b1f0-54638d0050c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:26.056527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 821/1645] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:26.076870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186f2eb-d2ea-49f7-b6b8-5c1a872be530 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:26.077233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186f2eb-d2ea-49f7-b6b8-5c1a872be530 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:26.077799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186f2eb-d2ea-49f7-b6b8-5c1a872be530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:26.136480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4055806-fffd-417a-b1f0-54638d0050c7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:26.139915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e186f2eb-d2ea-49f7-b6b8-5c1a872be530 None None] MFA Rules not processed for user `5a3cff65840a42d58952d7edbb56529f`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:26.143917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e186f2eb-d2ea-49f7-b6b8-5c1a872be530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:26.159599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 825/1646] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:26.176374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186f2eb-d2ea-49f7-b6b8-5c1a872be530 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:26.188784 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:26.199093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186f2eb-d2ea-49f7-b6b8-5c1a872be530 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:26.206762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4d86e-aa00-4edd-a60d-94f80aed7b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:26.207931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4d86e-aa00-4edd-a60d-94f80aed7b34 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:26.208476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4d86e-aa00-4edd-a60d-94f80aed7b34 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:26.208971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4d86e-aa00-4edd-a60d-94f80aed7b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:26.221309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4d86e-aa00-4edd-a60d-94f80aed7b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:26.223397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4d86e-aa00-4edd-a60d-94f80aed7b34 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:26.236519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 826/1647] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:26.295875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4055806-fffd-417a-b1f0-54638d0050c7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:26.312586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:26.315926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:26.316253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:26.316558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] PATH_INFO: `/v3/users/8f6ed3b32bdc4cd49b17f2bac3731907` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:26.324594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6ed3b32bdc4cd49b17f2bac3731907)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:26.324594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:26.651782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:26.712761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6ed3b32bdc4cd49b17f2bac3731907'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:26.713786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6ed3b32bdc4cd49b17f2bac3731907'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:26.714577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6ed3b32bdc4cd49b17f2bac3731907'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:26.768165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6ed3b32bdc4cd49b17f2bac3731907'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:26.799677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6ed3b32bdc4cd49b17f2bac3731907'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:26.909020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 822/1648] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:26 2022] DELETE /identity/v3/users/8f6ed3b32bdc4cd49b17f2bac3731907 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:26.910848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333198da-0371-4047-89af-33628e403b0e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:26.911166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333198da-0371-4047-89af-33628e403b0e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:26.911447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333198da-0371-4047-89af-33628e403b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:26.965817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-333198da-0371-4047-89af-33628e403b0e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:26.967083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-333198da-0371-4047-89af-33628e403b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:27.136553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:27.139565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:27.165935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 827/1649] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:27.201178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333198da-0371-4047-89af-33628e403b0e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:27.203537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-333198da-0371-4047-89af-33628e403b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:27.330121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b354-31c7-4ecd-97a6-8c00a5d067f5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:27.345319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:27.346490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:27.347773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:27.348215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] PATH_INFO: `/v3/users/ed9d88ad93a04a24a699fc90189c084d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:27.352900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9d88ad93a04a24a699fc90189c084d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:27.356249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:27.395528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333198da-0371-4047-89af-33628e403b0e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:27.403435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585cc47-72a3-453d-bfd6-fc69645c3cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:27.404612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585cc47-72a3-453d-bfd6-fc69645c3cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:27.405066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585cc47-72a3-453d-bfd6-fc69645c3cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:27.406333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585cc47-72a3-453d-bfd6-fc69645c3cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:27.428454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585cc47-72a3-453d-bfd6-fc69645c3cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:27.431748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585cc47-72a3-453d-bfd6-fc69645c3cb2 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:27.450333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 828/1650] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:27.609707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9d88ad93a04a24a699fc90189c084d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:27.611306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9d88ad93a04a24a699fc90189c084d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:27.612171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9d88ad93a04a24a699fc90189c084d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:27.639753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9d88ad93a04a24a699fc90189c084d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:27.655437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fa4763d6-5df4-4392-a096-1fee1837341f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9d88ad93a04a24a699fc90189c084d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:27.783439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a154b-2d01-48cd-ac90-0d7354813111 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:27.783439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a154b-2d01-48cd-ac90-0d7354813111 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:27.783439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a154b-2d01-48cd-ac90-0d7354813111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:27.783871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 823/1651] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:27 2022] DELETE /identity/v3/users/ed9d88ad93a04a24a699fc90189c084d => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:27.822382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-498a154b-2d01-48cd-ac90-0d7354813111 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:27.823844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-498a154b-2d01-48cd-ac90-0d7354813111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:27.901624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5a53-f5bf-458f-b704-66975b0a4c9a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:27.901915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5a53-f5bf-458f-b704-66975b0a4c9a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:27.902196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5a53-f5bf-458f-b704-66975b0a4c9a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:27.903974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 824/1652] 10.222.0.123 () {54 vars in 917 bytes} [Thu May 26 18:12:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 18:12:27.918856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f8342-3726-4ab5-b6a3-b03c5f414bcd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:27.919692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f8342-3726-4ab5-b6a3-b03c5f414bcd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:27.919692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f8342-3726-4ab5-b6a3-b03c5f414bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:28.016710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 829/1653] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:28.022677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ad5f8342-3726-4ab5-b6a3-b03c5f414bcd None None] MFA Rules not processed for user `66452133fd6348109e3065303947ecce`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:28.023884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ad5f8342-3726-4ab5-b6a3-b03c5f414bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:28.034976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a154b-2d01-48cd-ac90-0d7354813111 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:28.036489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-498a154b-2d01-48cd-ac90-0d7354813111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:28.062691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:28.122221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:28.147448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 825/1654] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:12:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 26 18:12:28.182334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f8342-3726-4ab5-b6a3-b03c5f414bcd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:28.185294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ad5f8342-3726-4ab5-b6a3-b03c5f414bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:28.198172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a154b-2d01-48cd-ac90-0d7354813111 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:28.231179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:28.233195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:28.235175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:28.235953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:28.246803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f8342-3726-4ab5-b6a3-b03c5f414bcd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:28.268460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:28.274414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:28.275347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a386-7b3a-4003-ac4a-c73936c8b91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:28.276614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a386-7b3a-4003-ac4a-c73936c8b91a service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:28.276614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a386-7b3a-4003-ac4a-c73936c8b91a service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:28.276866 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a386-7b3a-4003-ac4a-c73936c8b91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:28.303106 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903a386-7b3a-4003-ac4a-c73936c8b91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:28.304871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 830/1655] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:28.305803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903a386-7b3a-4003-ac4a-c73936c8b91a service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:28.327495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 826/1656] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:29.216521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:29.221037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:29.250035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2d272-ae5e-4398-a04a-c8b506d0dc4e service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:29.265328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:29.266502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:29.267150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:29.269084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] PATH_INFO: `/v3/projects/eb4abeb0c58a4a7fb8e649fc4e1700d9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:29.271562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4abeb0c58a4a7fb8e649fc4e1700d9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:29.278507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:29.483154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4abeb0c58a4a7fb8e649fc4e1700d9', 'request_id': 'req-e6eb224c-6958-4696-b6f2-841fac1962b4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:29.583567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4abeb0c58a4a7fb8e649fc4e1700d9', 'request_id': 'req-e6eb224c-6958-4696-b6f2-841fac1962b4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:29.597418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4abeb0c58a4a7fb8e649fc4e1700d9', 'request_id': 'req-e6eb224c-6958-4696-b6f2-841fac1962b4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:29.643308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] The token cache is being invalidate because project eb4abeb0c58a4a7fb8e649fc4e1700d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:29.645619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:29.649011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e6eb224c-6958-4696-b6f2-841fac1962b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:29.657007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 831/1657] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:29 2022] DELETE /identity/v3/projects/eb4abeb0c58a4a7fb8e649fc4e1700d9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:29.665925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333451a-2495-4fc8-b6af-57644eb1ee9c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:29.666376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333451a-2495-4fc8-b6af-57644eb1ee9c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:29.666514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333451a-2495-4fc8-b6af-57644eb1ee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:29.711258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3333451a-2495-4fc8-b6af-57644eb1ee9c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:29.717468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3333451a-2495-4fc8-b6af-57644eb1ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:29.835042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58407a-03ea-449d-ae7b-d4ad26b5ac58 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:29.835342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58407a-03ea-449d-ae7b-d4ad26b5ac58 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:29.835610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58407a-03ea-449d-ae7b-d4ad26b5ac58 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:29.837725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 832/1658] 10.222.0.123 () {54 vars in 965 bytes} [Thu May 26 18:12:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:12:29.844244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce6d0f-c8c7-4750-9774-295ea836d223 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:29.844604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce6d0f-c8c7-4750-9774-295ea836d223 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:29.844834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce6d0f-c8c7-4750-9774-295ea836d223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:29.897445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 827/1659] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:29.907000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3673f-75e6-4152-b3ee-90e109a3aa11 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:29.907858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3673f-75e6-4152-b3ee-90e109a3aa11 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:29.910078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3673f-75e6-4152-b3ee-90e109a3aa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:29.929861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8fce6d0f-c8c7-4750-9774-295ea836d223 None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:29.931141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8fce6d0f-c8c7-4750-9774-295ea836d223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:29.947156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-62d3673f-75e6-4152-b3ee-90e109a3aa11 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:29.950189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-62d3673f-75e6-4152-b3ee-90e109a3aa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:29.980432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 828/1660] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:29.984719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3673f-75e6-4152-b3ee-90e109a3aa11 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:30.047393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3673f-75e6-4152-b3ee-90e109a3aa11 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:30.055918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:30.057972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:30.057972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:30.058342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:30.059654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:30.061379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:30.064238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:30.092222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 829/1661] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:30.099914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:30.141681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5093c-c434-460d-8f10-0ec9a9f9527c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:30.153535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593801-9fa9-4f69-94d5-69c8d57e0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:30.157847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593801-9fa9-4f69-94d5-69c8d57e0cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:30.157847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593801-9fa9-4f69-94d5-69c8d57e0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:30.157847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28593801-9fa9-4f69-94d5-69c8d57e0cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:30.157847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28593801-9fa9-4f69-94d5-69c8d57e0cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:30.159691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28593801-9fa9-4f69-94d5-69c8d57e0cc1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:30.329364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 830/1662] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:30 2022] POST /identity/v3/projects => generated 406 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:30.333808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593801-9fa9-4f69-94d5-69c8d57e0cc1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:30.767470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28593801-9fa9-4f69-94d5-69c8d57e0cc1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:30.810320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1cbc-837a-4c8c-b901-122f3d2d4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:30.812728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1cbc-837a-4c8c-b901-122f3d2d4d62 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:30.813015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1cbc-837a-4c8c-b901-122f3d2d4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:30.813293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1cbc-837a-4c8c-b901-122f3d2d4d62 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:30.815537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a1cbc-837a-4c8c-b901-122f3d2d4d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:30.822581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 833/1663] 10.222.0.123 () {58 vars in 1062 bytes} [Thu May 26 18:12:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 979 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:30.825048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce6d0f-c8c7-4750-9774-295ea836d223 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:30.831139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8fce6d0f-c8c7-4750-9774-295ea836d223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:30.844532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a1cbc-837a-4c8c-b901-122f3d2d4d62 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:30.872492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce6d0f-c8c7-4750-9774-295ea836d223 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:30.891009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:30.893623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:30.895320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:30.900648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] PATH_INFO: `/v3/projects/dd230cfc335346099c3bdd70232a3457` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:30.915581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd230cfc335346099c3bdd70232a3457)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:30.923434 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:30.970251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 831/1664] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:30 2022] POST /identity/v3/users => generated 304 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:30.971144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1cbc-837a-4c8c-b901-122f3d2d4d62 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:30.990963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:31.148049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd230cfc335346099c3bdd70232a3457', 'request_id': 'req-b83860df-9f39-4b95-8491-314e3832dbec'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:31.150771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:31.172738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1cbc-837a-4c8c-b901-122f3d2d4d62 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:31.285959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd230cfc335346099c3bdd70232a3457', 'request_id': 'req-b83860df-9f39-4b95-8491-314e3832dbec'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:31.301501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd230cfc335346099c3bdd70232a3457', 'request_id': 'req-b83860df-9f39-4b95-8491-314e3832dbec'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:31.333617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:31.335047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] The token cache is being invalidate because project dd230cfc335346099c3bdd70232a3457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:31.335293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:31.336971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:31.337447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:31.337753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:31.338038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:31.339896 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 834/1665] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:30 2022] DELETE /identity/v3/projects/dd230cfc335346099c3bdd70232a3457 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:31.342059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:31.343326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:31.350579 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:31.382927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:31.388674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:31.429590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 832/1666] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:31.431254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:31.433776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:31.623511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83860df-9f39-4b95-8491-314e3832dbec admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:31.636650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369faf5-fd3d-4269-add3-f9b922c2b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:31.637663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369faf5-fd3d-4269-add3-f9b922c2b35d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:31.637663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369faf5-fd3d-4269-add3-f9b922c2b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:31.637941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369faf5-fd3d-4269-add3-f9b922c2b35d admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:31.639220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369faf5-fd3d-4269-add3-f9b922c2b35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:31.640972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369faf5-fd3d-4269-add3-f9b922c2b35d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:31.658822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 835/1667] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:31 2022] GET /identity/v3/roles => generated 1427 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:31.663839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369faf5-fd3d-4269-add3-f9b922c2b35d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:31.711510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369faf5-fd3d-4269-add3-f9b922c2b35d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:31.750195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3ffb7-e370-4141-afd4-30bd54f94880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:31.750891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3ffb7-e370-4141-afd4-30bd54f94880 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:31.751158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3ffb7-e370-4141-afd4-30bd54f94880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:31.751438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3ffb7-e370-4141-afd4-30bd54f94880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:31.752181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3ffb7-e370-4141-afd4-30bd54f94880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:31.753860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3ffb7-e370-4141-afd4-30bd54f94880 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:31.811228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 836/1668] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:31 2022] GET /identity/v3/roles => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:31.842114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3ffb7-e370-4141-afd4-30bd54f94880 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:31.851363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05da7a-8bad-46a1-bbbd-8e1576488007 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:31.869357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:31.870295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:31.870295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:31.870472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] PATH_INFO: `/v3/users/1bd0c26ba4b24d7ab1f83cb17f1db467` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:31.876216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd0c26ba4b24d7ab1f83cb17f1db467)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:31.877856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3ffb7-e370-4141-afd4-30bd54f94880 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:31.887513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:31.905342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf8785-ce33-4ca9-bf01-d940c3760eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:31.906595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8785-ce33-4ca9-bf01-d940c3760eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:31.906952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8785-ce33-4ca9-bf01-d940c3760eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:31.907300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8785-ce33-4ca9-bf01-d940c3760eb2 admin admin] PATH_INFO: `/v3/projects/9d23f3b8e3cc4abcbb5ede2ccab8114e/users/8dbf8a4220a14db18ba74e91f4e5548e/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:31.959819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf8785-ce33-4ca9-bf01-d940c3760eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d23f3b8e3cc4abcbb5ede2ccab8114e, user_id=8dbf8a4220a14db18ba74e91f4e5548e, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:31.963765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf8785-ce33-4ca9-bf01-d940c3760eb2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:32.127480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 837/1669] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:31 2022] PUT /identity/v3/projects/9d23f3b8e3cc4abcbb5ede2ccab8114e/users/8dbf8a4220a14db18ba74e91f4e5548e/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:32.140869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741eb56-4727-4ff8-9fc1-d5f4d21eaef5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:32.141294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741eb56-4727-4ff8-9fc1-d5f4d21eaef5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:32.141649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741eb56-4727-4ff8-9fc1-d5f4d21eaef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:32.204902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:32.223629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd0c26ba4b24d7ab1f83cb17f1db467'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:32.225407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd0c26ba4b24d7ab1f83cb17f1db467'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:32.230185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd0c26ba4b24d7ab1f83cb17f1db467'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:32.238118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1741eb56-4727-4ff8-9fc1-d5f4d21eaef5 None None] MFA Rules not processed for user `8dbf8a4220a14db18ba74e91f4e5548e`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:32.243338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1741eb56-4727-4ff8-9fc1-d5f4d21eaef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:32.269959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd0c26ba4b24d7ab1f83cb17f1db467'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:32.302108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd0c26ba4b24d7ab1f83cb17f1db467'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:32.427454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 833/1670] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:31 2022] DELETE /identity/v3/users/1bd0c26ba4b24d7ab1f83cb17f1db467 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:32.534647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 838/1671] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:32 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:32.540900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:32.542578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:32.774085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed32da-087a-446b-a2a7-0977408f54d9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:32.786717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b467506-eb3e-430f-be08-9e3b75bc3d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:32.789375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467506-eb3e-430f-be08-9e3b75bc3d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:32.791322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467506-eb3e-430f-be08-9e3b75bc3d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:32.791638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467506-eb3e-430f-be08-9e3b75bc3d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:32.797556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b467506-eb3e-430f-be08-9e3b75bc3d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:32.799851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b467506-eb3e-430f-be08-9e3b75bc3d6f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:32.939070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 834/1672] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:32 2022] POST /identity/v3/projects => generated 406 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:32.940078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741eb56-4727-4ff8-9fc1-d5f4d21eaef5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:33.019866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:33.104213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741eb56-4727-4ff8-9fc1-d5f4d21eaef5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:33.407245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237234-b8c0-4eaa-a202-530be4ec42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:33.407956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237234-b8c0-4eaa-a202-530be4ec42dc admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:33.408237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237234-b8c0-4eaa-a202-530be4ec42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:33.417818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237234-b8c0-4eaa-a202-530be4ec42dc admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:33.420676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237234-b8c0-4eaa-a202-530be4ec42dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:33.432728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237234-b8c0-4eaa-a202-530be4ec42dc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:33.554645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400af7-e397-473b-b960-0477252ef31c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:33.555002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400af7-e397-473b-b960-0477252ef31c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:33.555718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400af7-e397-473b-b960-0477252ef31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:33.600988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 839/1673] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:32 2022] POST /identity/v3/users => generated 310 bytes in 658 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:33.603460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237234-b8c0-4eaa-a202-530be4ec42dc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:33.618729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237234-b8c0-4eaa-a202-530be4ec42dc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:33.626710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257a34-bd6c-4d94-90dd-5aeb69d62516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:33.627498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257a34-bd6c-4d94-90dd-5aeb69d62516 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:33.627913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-67400af7-e397-473b-b960-0477252ef31c None None] MFA Rules not processed for user `ebdb2f4338f842f19f1cba1be13597c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:33.628166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257a34-bd6c-4d94-90dd-5aeb69d62516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:33.628479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257a34-bd6c-4d94-90dd-5aeb69d62516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:33.629740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257a34-bd6c-4d94-90dd-5aeb69d62516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:33.629999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-67400af7-e397-473b-b960-0477252ef31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:33.633140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257a34-bd6c-4d94-90dd-5aeb69d62516 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:33.656362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 840/1674] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:33 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:33.661401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257a34-bd6c-4d94-90dd-5aeb69d62516 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:33.695322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257a34-bd6c-4d94-90dd-5aeb69d62516 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:33.724364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aebdd-4d23-4861-a42c-d425c64e0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:33.726463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aebdd-4d23-4861-a42c-d425c64e0bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:33.727967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aebdd-4d23-4861-a42c-d425c64e0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:33.728352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aebdd-4d23-4861-a42c-d425c64e0bfc admin admin] PATH_INFO: `/v3/projects/15cd998e049e43649c15285fcc5eb570/users/1f6501eccbfd4466ac6875b7c6f81642/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:33.760416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71aebdd-4d23-4861-a42c-d425c64e0bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cd998e049e43649c15285fcc5eb570, user_id=1f6501eccbfd4466ac6875b7c6f81642, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:33.764017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71aebdd-4d23-4861-a42c-d425c64e0bfc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:33.828414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 835/1675] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:33.829589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67400af7-e397-473b-b960-0477252ef31c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:33.837728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-67400af7-e397-473b-b960-0477252ef31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:33.899421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 841/1676] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:33 2022] PUT /identity/v3/projects/15cd998e049e43649c15285fcc5eb570/users/1f6501eccbfd4466ac6875b7c6f81642/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:33.900751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aebdd-4d23-4861-a42c-d425c64e0bfc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:33.952776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:34.032455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67400af7-e397-473b-b960-0477252ef31c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:34.095979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aebdd-4d23-4861-a42c-d425c64e0bfc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:34.112080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e9c99-54c6-41e9-8f82-117337de82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:34.112902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9c99-54c6-41e9-8f82-117337de82b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:34.113509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9c99-54c6-41e9-8f82-117337de82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:34.114441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e9c99-54c6-41e9-8f82-117337de82b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:34.116717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e9c99-54c6-41e9-8f82-117337de82b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:34.120746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e9c99-54c6-41e9-8f82-117337de82b4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:34.128685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:34.129709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:34.130214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:34.130655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:34.150641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 842/1677] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:33 2022] GET /identity/v3/roles => generated 1427 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:34.153671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e9c99-54c6-41e9-8f82-117337de82b4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:34.175651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e9c99-54c6-41e9-8f82-117337de82b4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:34.187822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796e46a-f29f-4b75-9dcd-13d41b859120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:34.188957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796e46a-f29f-4b75-9dcd-13d41b859120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:34.189549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796e46a-f29f-4b75-9dcd-13d41b859120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:34.189999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796e46a-f29f-4b75-9dcd-13d41b859120 admin admin] PATH_INFO: `/v3/projects/15cd998e049e43649c15285fcc5eb570/users/1f6501eccbfd4466ac6875b7c6f81642/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:34.192466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796e46a-f29f-4b75-9dcd-13d41b859120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cd998e049e43649c15285fcc5eb570, user_id=1f6501eccbfd4466ac6875b7c6f81642, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:34.197012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796e46a-f29f-4b75-9dcd-13d41b859120 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:34.212482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 843/1678] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:34 2022] PUT /identity/v3/projects/15cd998e049e43649c15285fcc5eb570/users/1f6501eccbfd4466ac6875b7c6f81642/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:34.224091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b199-1283-4e8a-bb0d-a3fe77e8eca8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:34.224214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b199-1283-4e8a-bb0d-a3fe77e8eca8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:34.224545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308b199-1283-4e8a-bb0d-a3fe77e8eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:34.307513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:34.309850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:34.315409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f308b199-1283-4e8a-bb0d-a3fe77e8eca8 None None] MFA Rules not processed for user `1f6501eccbfd4466ac6875b7c6f81642`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:34.317133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f308b199-1283-4e8a-bb0d-a3fe77e8eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:34.354093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 836/1679] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:34.357869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:34.364991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:34.409887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840dbc3-e7b5-447b-baa8-cf77baf9d07c service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:34.477090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 844/1680] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:34.487545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b199-1283-4e8a-bb0d-a3fe77e8eca8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:34.489161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f308b199-1283-4e8a-bb0d-a3fe77e8eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:34.569297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:34.570325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:34.570599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:34.570877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] PATH_INFO: `/v3/projects/61058d35affb4070a76f02bc41f15659` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:34.573127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=61058d35affb4070a76f02bc41f15659)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:34.576906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:12:34.576906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: warnings.warn(msg) May 26 18:12:34.576906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: May 26 18:12:34.579302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:34.674668 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308b199-1283-4e8a-bb0d-a3fe77e8eca8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:34.685267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f5853-1554-4a49-a2b1-fcbaf0fd0288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:34.688508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5853-1554-4a49-a2b1-fcbaf0fd0288 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:34.688802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5853-1554-4a49-a2b1-fcbaf0fd0288 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:34.689086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5853-1554-4a49-a2b1-fcbaf0fd0288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:34.721443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f5853-1554-4a49-a2b1-fcbaf0fd0288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:34.724167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f5853-1554-4a49-a2b1-fcbaf0fd0288 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:34.764274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 845/1681] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:34.829616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61058d35affb4070a76f02bc41f15659', 'request_id': 'req-04206037-2d95-4a30-8d40-18964dd598fd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:34.971414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61058d35affb4070a76f02bc41f15659', 'request_id': 'req-04206037-2d95-4a30-8d40-18964dd598fd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.014630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61058d35affb4070a76f02bc41f15659', 'request_id': 'req-04206037-2d95-4a30-8d40-18964dd598fd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.041659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] The token cache is being invalidate because project 61058d35affb4070a76f02bc41f15659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:35.041949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.043049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.045961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 837/1682] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:34 2022] DELETE /identity/v3/projects/61058d35affb4070a76f02bc41f15659 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:35.051836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245af16-b6a9-44b0-8d0d-1e1bc5fc8552 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:35.052390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245af16-b6a9-44b0-8d0d-1e1bc5fc8552 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:35.052990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245af16-b6a9-44b0-8d0d-1e1bc5fc8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:35.064646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:35.066587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:35.096347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9245af16-b6a9-44b0-8d0d-1e1bc5fc8552 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:35.097240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9245af16-b6a9-44b0-8d0d-1e1bc5fc8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:35.231706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04206037-2d95-4a30-8d40-18964dd598fd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:35.253995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:35.254896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:35.255184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:35.255464 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] PATH_INFO: `/v3/users/8dbf8a4220a14db18ba74e91f4e5548e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:35.259548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbf8a4220a14db18ba74e91f4e5548e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:35.262451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:35.296847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 846/1683] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:35.305748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefe57-9d51-447c-87ec-f46c5bed0dea None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:35.321330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefe57-9d51-447c-87ec-f46c5bed0dea None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:35.321330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefe57-9d51-447c-87ec-f46c5bed0dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:35.386529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-65fefe57-9d51-447c-87ec-f46c5bed0dea None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:35.387545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-65fefe57-9d51-447c-87ec-f46c5bed0dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:35.462881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 847/1684] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:35.467897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefe57-9d51-447c-87ec-f46c5bed0dea None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:35.488996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefe57-9d51-447c-87ec-f46c5bed0dea None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:35.505836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:35.507453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:35.507880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:35.508322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:35.510762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:35.511445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:35.532897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:35.556016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 848/1685] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:35.560170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:35.598118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43618d-5c90-4177-91b5-e2cc9e55fd95 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:35.641032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:35.644007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:35.644293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:35.655470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:35.655470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:35.659123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:35.668796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbf8a4220a14db18ba74e91f4e5548e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.671158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbf8a4220a14db18ba74e91f4e5548e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.672172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbf8a4220a14db18ba74e91f4e5548e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.700764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbf8a4220a14db18ba74e91f4e5548e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.735249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a753373b-d5ee-4667-942c-814419297de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbf8a4220a14db18ba74e91f4e5548e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:35.843306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 838/1686] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:35 2022] DELETE /identity/v3/users/8dbf8a4220a14db18ba74e91f4e5548e => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:12:35.847644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9f6-1297-4628-9b47-ea9acb1da4a1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:35.848111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9f6-1297-4628-9b47-ea9acb1da4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:35.848550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9f6-1297-4628-9b47-ea9acb1da4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:35.861269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 849/1687] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:35 2022] POST /identity/v3/projects => generated 366 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:35.862502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:35.868407 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:35.917538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-48bad9f6-1297-4628-9b47-ea9acb1da4a1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:35.919024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-48bad9f6-1297-4628-9b47-ea9acb1da4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:35.956984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:36.017455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f930-9391-46e1-b20e-460abb7539b1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:36.031742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e61f89-2c11-43fb-b2dc-70ff579ffcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:36.032483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e61f89-2c11-43fb-b2dc-70ff579ffcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:36.033350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e61f89-2c11-43fb-b2dc-70ff579ffcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:36.033350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e61f89-2c11-43fb-b2dc-70ff579ffcb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:36.038130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e61f89-2c11-43fb-b2dc-70ff579ffcb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:36.050235 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e61f89-2c11-43fb-b2dc-70ff579ffcb5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:36.070431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 839/1688] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:36.085209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad9f6-1297-4628-9b47-ea9acb1da4a1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:36.086804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-48bad9f6-1297-4628-9b47-ea9acb1da4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:36.171679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 850/1689] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:35 2022] POST /identity/v3/users => generated 284 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:36.176402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e61f89-2c11-43fb-b2dc-70ff579ffcb5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:36.220677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e61f89-2c11-43fb-b2dc-70ff579ffcb5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:36.230311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d6ca4-b082-4b64-a20d-1930d205aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:36.233003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d6ca4-b082-4b64-a20d-1930d205aec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:36.237483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d6ca4-b082-4b64-a20d-1930d205aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:36.240187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d6ca4-b082-4b64-a20d-1930d205aec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:36.255285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d6ca4-b082-4b64-a20d-1930d205aec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:36.260687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d6ca4-b082-4b64-a20d-1930d205aec8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:36.285270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 851/1690] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:36 2022] GET /identity/v3/roles => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:12:36.290981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d6ca4-b082-4b64-a20d-1930d205aec8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:36.309560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d6ca4-b082-4b64-a20d-1930d205aec8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:36.314781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad9f6-1297-4628-9b47-ea9acb1da4a1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:36.329296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1893e4-87bb-4dd3-99d2-0e3149fb9fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:36.330013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1893e4-87bb-4dd3-99d2-0e3149fb9fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:36.333383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35820d-8637-4c4c-96d8-b7ea4de698c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:36.334122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35820d-8637-4c4c-96d8-b7ea4de698c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:36.334550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35820d-8637-4c4c-96d8-b7ea4de698c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:36.335195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35820d-8637-4c4c-96d8-b7ea4de698c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:36.335844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1893e4-87bb-4dd3-99d2-0e3149fb9fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:36.336092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1893e4-87bb-4dd3-99d2-0e3149fb9fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:36.336898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1893e4-87bb-4dd3-99d2-0e3149fb9fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:36.338559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1893e4-87bb-4dd3-99d2-0e3149fb9fdd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:36.364896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35820d-8637-4c4c-96d8-b7ea4de698c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:36.368319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35820d-8637-4c4c-96d8-b7ea4de698c6 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:36.374403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 852/1691] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:36 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:12:36.378318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1893e4-87bb-4dd3-99d2-0e3149fb9fdd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:36.393857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 840/1692] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:36.400972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1893e4-87bb-4dd3-99d2-0e3149fb9fdd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:36.417508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbfc36-6171-4d0b-9120-d294aabddf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:36.419459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfc36-6171-4d0b-9120-d294aabddf3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:36.419940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfc36-6171-4d0b-9120-d294aabddf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:36.420532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfc36-6171-4d0b-9120-d294aabddf3a admin admin] PATH_INFO: `/v3/projects/73156195dc0f49618c797644cf19662e/users/659b99b34b134eb7844038e965eea4d3/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:36.451120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbfc36-6171-4d0b-9120-d294aabddf3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73156195dc0f49618c797644cf19662e, user_id=659b99b34b134eb7844038e965eea4d3, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:36.456445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbfc36-6171-4d0b-9120-d294aabddf3a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:36.558854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 853/1693] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:36 2022] PUT /identity/v3/projects/73156195dc0f49618c797644cf19662e/users/659b99b34b134eb7844038e965eea4d3/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:12:36.572195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ac21-7c5e-4e36-be4b-58157fe0e66d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:36.573150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ac21-7c5e-4e36-be4b-58157fe0e66d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:36.573437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93ac21-7c5e-4e36-be4b-58157fe0e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:36.645387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ca93ac21-7c5e-4e36-be4b-58157fe0e66d None None] MFA Rules not processed for user `659b99b34b134eb7844038e965eea4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:36.647458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ca93ac21-7c5e-4e36-be4b-58157fe0e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:36.821535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 841/1694] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:36.825795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbfc36-6171-4d0b-9120-d294aabddf3a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:36.856864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93ac21-7c5e-4e36-be4b-58157fe0e66d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:36.862865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ca93ac21-7c5e-4e36-be4b-58157fe0e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:37.012680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbfc36-6171-4d0b-9120-d294aabddf3a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:37.027381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab86d0e-9f62-42e7-a85a-0edd167332f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:37.031343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab86d0e-9f62-42e7-a85a-0edd167332f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:37.032329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab86d0e-9f62-42e7-a85a-0edd167332f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:37.032637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab86d0e-9f62-42e7-a85a-0edd167332f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:37.036454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab86d0e-9f62-42e7-a85a-0edd167332f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:37.045438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab86d0e-9f62-42e7-a85a-0edd167332f0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:37.216273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:37.275981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 854/1695] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:36 2022] POST /identity/v3/projects => generated 370 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:37.289727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab86d0e-9f62-42e7-a85a-0edd167332f0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:37.323506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93ac21-7c5e-4e36-be4b-58157fe0e66d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:37.416992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab86d0e-9f62-42e7-a85a-0edd167332f0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:37.429481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763d9fc-833f-464c-90af-53ecee898594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:37.432834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d9fc-833f-464c-90af-53ecee898594 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:37.434580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d9fc-833f-464c-90af-53ecee898594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:37.435303 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d9fc-833f-464c-90af-53ecee898594 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:37.437493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763d9fc-833f-464c-90af-53ecee898594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:37.441119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:37.442552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:37.443198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:37.444323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] PATH_INFO: `/v3/users/b5f139f4070b4ad98c8db2b843282905` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:37.445188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763d9fc-833f-464c-90af-53ecee898594 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:37.445977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f139f4070b4ad98c8db2b843282905)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:37.449328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:37.584585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 855/1696] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:37 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:37.597661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763d9fc-833f-464c-90af-53ecee898594 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:37.620687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763d9fc-833f-464c-90af-53ecee898594 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:37.638346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8922704-39e9-4c91-8b31-94610c8ec08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:37.640941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922704-39e9-4c91-8b31-94610c8ec08a admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:37.641810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922704-39e9-4c91-8b31-94610c8ec08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:37.642726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922704-39e9-4c91-8b31-94610c8ec08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:37.644461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8922704-39e9-4c91-8b31-94610c8ec08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:37.646277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8922704-39e9-4c91-8b31-94610c8ec08a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:37.680513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 856/1697] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:37 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:37.692403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8922704-39e9-4c91-8b31-94610c8ec08a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:37.699613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8922704-39e9-4c91-8b31-94610c8ec08a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:37.710923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f139f4070b4ad98c8db2b843282905'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:37.712548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f139f4070b4ad98c8db2b843282905'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:37.716568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f139f4070b4ad98c8db2b843282905'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:37.729092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:37.730514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:37.730793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:37.731066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] PATH_INFO: `/v3/projects/9b9d696758214fb7bc81aeed99fd14b1/users/8f6490a1d1824c32817f0bbbc5cd8c8e/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:37.760420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f139f4070b4ad98c8db2b843282905'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:37.772860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9d696758214fb7bc81aeed99fd14b1, user_id=8f6490a1d1824c32817f0bbbc5cd8c8e, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:37.775589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:37.793091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-efd58b80-d7c0-4b5f-ab5c-117efb270dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f139f4070b4ad98c8db2b843282905'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:37.859157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 857/1698] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:37 2022] PUT /identity/v3/projects/9b9d696758214fb7bc81aeed99fd14b1/users/8f6490a1d1824c32817f0bbbc5cd8c8e/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:37.864626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:37.869817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:37.969438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 842/1699] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:36 2022] DELETE /identity/v3/users/b5f139f4070b4ad98c8db2b843282905 => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:37.971444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721bace-d20b-4701-bad4-4c916ebbfe08 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:37.971884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721bace-d20b-4701-bad4-4c916ebbfe08 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:37.973012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721bace-d20b-4701-bad4-4c916ebbfe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:38.033187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6d036-75e0-45e4-9302-3d0059d9ca1c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:38.036228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5721bace-d20b-4701-bad4-4c916ebbfe08 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:38.041168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5721bace-d20b-4701-bad4-4c916ebbfe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:38.191337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe9446-2e9a-4138-bf0e-b81dddc10a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:38.192093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9446-2e9a-4138-bf0e-b81dddc10a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:38.195515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9446-2e9a-4138-bf0e-b81dddc10a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:38.195864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9446-2e9a-4138-bf0e-b81dddc10a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:38.205206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe9446-2e9a-4138-bf0e-b81dddc10a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:38.205285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 843/1700] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:38.205285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f6820-699d-4bf5-9445-f355cb2d9d03 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:38.205285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f6820-699d-4bf5-9445-f355cb2d9d03 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:38.205285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f6820-699d-4bf5-9445-f355cb2d9d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:38.213162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe9446-2e9a-4138-bf0e-b81dddc10a28 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:38.233045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 858/1701] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:37 2022] GET /identity/v3/roles => generated 1427 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:38.238466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe9446-2e9a-4138-bf0e-b81dddc10a28 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:38.248153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-284f6820-699d-4bf5-9445-f355cb2d9d03 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:38.250477 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-284f6820-699d-4bf5-9445-f355cb2d9d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:38.264643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe9446-2e9a-4138-bf0e-b81dddc10a28 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:38.269533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 844/1702] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:38.270713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:38.272536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:38.274260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:38.274260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] PATH_INFO: `/v3/projects/9b9d696758214fb7bc81aeed99fd14b1/users/8f6490a1d1824c32817f0bbbc5cd8c8e/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:38.276333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9d696758214fb7bc81aeed99fd14b1, user_id=8f6490a1d1824c32817f0bbbc5cd8c8e, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:38.290589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:38.313567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 859/1703] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:38 2022] PUT /identity/v3/projects/9b9d696758214fb7bc81aeed99fd14b1/users/8f6490a1d1824c32817f0bbbc5cd8c8e/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:38.325476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73c25-9046-43a3-9f3b-dceb11bf98f4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:38.325794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73c25-9046-43a3-9f3b-dceb11bf98f4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:38.327341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73c25-9046-43a3-9f3b-dceb11bf98f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:38.330227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:38.393271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f1a73c25-9046-43a3-9f3b-dceb11bf98f4 None None] MFA Rules not processed for user `8f6490a1d1824c32817f0bbbc5cd8c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:38.394503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f1a73c25-9046-43a3-9f3b-dceb11bf98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:38.400632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:38.432877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:38.438301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:38.599007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ada0-e076-4c16-a1e6-9cd2056a0909 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:38.599734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 845/1704] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:38.627598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:38.628259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:38.628564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:38.628838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:38.632734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73c25-9046-43a3-9f3b-dceb11bf98f4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:38.636852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f1a73c25-9046-43a3-9f3b-dceb11bf98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:38.874907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73c25-9046-43a3-9f3b-dceb11bf98f4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:38.884225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:38.895295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:38.900472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:38.901362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:38.901653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:38.901919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] PATH_INFO: `/v3/projects/9d23f3b8e3cc4abcbb5ede2ccab8114e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:38.909437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d23f3b8e3cc4abcbb5ede2ccab8114e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:38.918499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:38.939456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 860/1705] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:38.941845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:38.950719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:39.032461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:39.100423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75003f-9bdd-473d-b987-220133c63b95 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:39.131811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d23f3b8e3cc4abcbb5ede2ccab8114e', 'request_id': 'req-1e20747b-1b33-492f-b9e3-f03cc6afe681'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:39.242206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429dc64-7dae-4786-a411-26e6fad8bb8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:39.242909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429dc64-7dae-4786-a411-26e6fad8bb8c service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:39.243194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429dc64-7dae-4786-a411-26e6fad8bb8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:39.243474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429dc64-7dae-4786-a411-26e6fad8bb8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:39.251128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d23f3b8e3cc4abcbb5ede2ccab8114e', 'request_id': 'req-1e20747b-1b33-492f-b9e3-f03cc6afe681'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:39.261368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d23f3b8e3cc4abcbb5ede2ccab8114e', 'request_id': 'req-1e20747b-1b33-492f-b9e3-f03cc6afe681'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:39.292334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] The token cache is being invalidate because project 9d23f3b8e3cc4abcbb5ede2ccab8114e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:39.292625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:39.300805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:39.306796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 846/1706] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:38 2022] DELETE /identity/v3/projects/9d23f3b8e3cc4abcbb5ede2ccab8114e => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:39.308522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:39.316829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:39.440830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429dc64-7dae-4786-a411-26e6fad8bb8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:39.442713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429dc64-7dae-4786-a411-26e6fad8bb8c service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:39.481426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 861/1707] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:39.482497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429dc64-7dae-4786-a411-26e6fad8bb8c service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:39.603946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20747b-1b33-492f-b9e3-f03cc6afe681 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:39.619865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aad57-98ce-4297-b21b-37b9eae9ec6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:39.621086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aad57-98ce-4297-b21b-37b9eae9ec6f service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:39.621667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aad57-98ce-4297-b21b-37b9eae9ec6f service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:39.622159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aad57-98ce-4297-b21b-37b9eae9ec6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:39.626025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cd8aad57-98ce-4297-b21b-37b9eae9ec6f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:39.674459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429dc64-7dae-4786-a411-26e6fad8bb8c service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:39.690251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:39.692123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:39.692431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:39.692714 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] PATH_INFO: `/v3/users/1f6501eccbfd4466ac6875b7c6f81642` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:39.704489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6501eccbfd4466ac6875b7c6f81642)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:39.705806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:12:39.705806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: warnings.warn(msg) May 26 18:12:39.705806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: May 26 18:12:39.707128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:39.785320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:39.825174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aad57-98ce-4297-b21b-37b9eae9ec6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:39.826789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aad57-98ce-4297-b21b-37b9eae9ec6f service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:39.880016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 847/1708] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:12:39.881493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2bbed-0079-4fc4-bbfe-2d2bc932eb28 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:39.881794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2bbed-0079-4fc4-bbfe-2d2bc932eb28 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:39.886790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2bbed-0079-4fc4-bbfe-2d2bc932eb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:40.032031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6da2bbed-0079-4fc4-bbfe-2d2bc932eb28 None None] MFA Rules not processed for user `09ad128756994ea0b6333d0694b840b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:40.033446 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6da2bbed-0079-4fc4-bbfe-2d2bc932eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:40.057176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:40.151629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6501eccbfd4466ac6875b7c6f81642'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.153093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6501eccbfd4466ac6875b7c6f81642'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.153587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6501eccbfd4466ac6875b7c6f81642'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.194353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 848/1709] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:40.196077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2bbed-0079-4fc4-bbfe-2d2bc932eb28 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:40.198151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6da2bbed-0079-4fc4-bbfe-2d2bc932eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:40.210437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6501eccbfd4466ac6875b7c6f81642'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.242016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2bbed-0079-4fc4-bbfe-2d2bc932eb28 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:40.248099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d3482866-c7c2-42c3-be02-1cf285ad167e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6501eccbfd4466ac6875b7c6f81642'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.254482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:40.256259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:40.256742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:40.258387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] PATH_INFO: `/v3/projects/3889c734bb724a5aa665a4a6b8bfaa6b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:40.263052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3889c734bb724a5aa665a4a6b8bfaa6b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:40.271032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:40.396024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 862/1710] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:39 2022] DELETE /identity/v3/users/1f6501eccbfd4466ac6875b7c6f81642 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:40.398949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dff7c-f53f-42df-b95e-57cfebfd728f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:40.402870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dff7c-f53f-42df-b95e-57cfebfd728f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:40.403305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dff7c-f53f-42df-b95e-57cfebfd728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:40.438107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3889c734bb724a5aa665a4a6b8bfaa6b', 'request_id': 'req-f42f66ff-d46f-44bd-a0e1-11682ad163fa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.476067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b49dff7c-f53f-42df-b95e-57cfebfd728f None None] MFA Rules not processed for user `66452133fd6348109e3065303947ecce`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:40.476067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b49dff7c-f53f-42df-b95e-57cfebfd728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:40.518432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3889c734bb724a5aa665a4a6b8bfaa6b', 'request_id': 'req-f42f66ff-d46f-44bd-a0e1-11682ad163fa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.538043 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3889c734bb724a5aa665a4a6b8bfaa6b', 'request_id': 'req-f42f66ff-d46f-44bd-a0e1-11682ad163fa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.553358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:40.577811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] The token cache is being invalidate because project 3889c734bb724a5aa665a4a6b8bfaa6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:40.578110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.584693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:40.597362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 849/1711] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:40 2022] DELETE /identity/v3/projects/3889c734bb724a5aa665a4a6b8bfaa6b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:40.600717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:40.614495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:40.706731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 863/1712] 10.222.0.59 () {58 vars in 1019 bytes} [Thu May 26 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:40.708229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d7519-6233-4acd-94ad-7171441cba75 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:40.708551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d7519-6233-4acd-94ad-7171441cba75 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:40.708824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d7519-6233-4acd-94ad-7171441cba75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:40.748600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2d2d7519-6233-4acd-94ad-7171441cba75 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:40.749831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2d2d7519-6233-4acd-94ad-7171441cba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:40.783572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f66ff-d46f-44bd-a0e1-11682ad163fa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:40.792851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a3fff-b5d9-48e6-92f6-cbbddf79789a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:40.794019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a3fff-b5d9-48e6-92f6-cbbddf79789a service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:40.794417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a3fff-b5d9-48e6-92f6-cbbddf79789a service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:40.794904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a3fff-b5d9-48e6-92f6-cbbddf79789a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:40.797356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-455a3fff-b5d9-48e6-92f6-cbbddf79789a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:40.923022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a3fff-b5d9-48e6-92f6-cbbddf79789a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:40.925363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a3fff-b5d9-48e6-92f6-cbbddf79789a service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:40.940378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 864/1713] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:40.945504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d7519-6233-4acd-94ad-7171441cba75 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:40.947328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2d2d7519-6233-4acd-94ad-7171441cba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:40.980834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 850/1714] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:40.980977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d7519-6233-4acd-94ad-7171441cba75 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:40.982352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16756-f8cd-40cd-bf18-ab552396e97f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:40.982639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16756-f8cd-40cd-bf18-ab552396e97f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:40.982912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16756-f8cd-40cd-bf18-ab552396e97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:40.988436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0185e7-40ee-4870-a0fc-cfc190e91b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:40.989282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0185e7-40ee-4870-a0fc-cfc190e91b57 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:41.003754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0185e7-40ee-4870-a0fc-cfc190e91b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:41.003754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0185e7-40ee-4870-a0fc-cfc190e91b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:41.014724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0185e7-40ee-4870-a0fc-cfc190e91b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:41.017418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0185e7-40ee-4870-a0fc-cfc190e91b57 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:41.037333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 865/1715] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:41.102802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-55c16756-f8cd-40cd-bf18-ab552396e97f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:41.109046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-55c16756-f8cd-40cd-bf18-ab552396e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:41.153340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 851/1716] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:41.163958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0185e7-40ee-4870-a0fc-cfc190e91b57 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:41.203018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0185e7-40ee-4870-a0fc-cfc190e91b57 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:41.244476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49503d-18f1-4ba0-b4ea-7b04883e923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:41.247635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49503d-18f1-4ba0-b4ea-7b04883e923f admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:41.248624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49503d-18f1-4ba0-b4ea-7b04883e923f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:41.248917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49503d-18f1-4ba0-b4ea-7b04883e923f admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:41.249808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49503d-18f1-4ba0-b4ea-7b04883e923f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:41.250023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49503d-18f1-4ba0-b4ea-7b04883e923f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:41.357423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49503d-18f1-4ba0-b4ea-7b04883e923f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:41.357423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 866/1717] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:41.358679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16756-f8cd-40cd-bf18-ab552396e97f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:41.363978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16756-f8cd-40cd-bf18-ab552396e97f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:41.380021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08025-7c97-431b-b5b4-22c858cc25a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:41.383563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08025-7c97-431b-b5b4-22c858cc25a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:41.386326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08025-7c97-431b-b5b4-22c858cc25a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:41.386910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08025-7c97-431b-b5b4-22c858cc25a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:41.388252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a08025-7c97-431b-b5b4-22c858cc25a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:41.393951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a08025-7c97-431b-b5b4-22c858cc25a2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:41.599187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d713039-f2ff-4929-9bbb-c4fbf78e44d7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:41.602251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d713039-f2ff-4929-9bbb-c4fbf78e44d7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:41.602940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d713039-f2ff-4929-9bbb-c4fbf78e44d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:41.677711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0d713039-f2ff-4929-9bbb-c4fbf78e44d7 None None] MFA Rules not processed for user `95a7cc3020514672a7ab872cfdeabef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:41.688584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0d713039-f2ff-4929-9bbb-c4fbf78e44d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:41.867495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 867/1718] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:41.871220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e730f-20a0-4982-914d-561177c06a80 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:41.871523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e730f-20a0-4982-914d-561177c06a80 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:41.871809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e730f-20a0-4982-914d-561177c06a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:41.908459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c66e730f-20a0-4982-914d-561177c06a80 None None] MFA Rules not processed for user `95a7cc3020514672a7ab872cfdeabef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:41.911893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c66e730f-20a0-4982-914d-561177c06a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:41.939242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 868/1719] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:41.957757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e730f-20a0-4982-914d-561177c06a80 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:41.960626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c66e730f-20a0-4982-914d-561177c06a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:41.989644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e730f-20a0-4982-914d-561177c06a80 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:42.002073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:42.002954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:42.003349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:42.003759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:42.027102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:42.034053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.066038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 852/1720] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:41 2022] POST /identity/v3/projects => generated 372 bytes in 716 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:42.101028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 869/1721] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:42.104166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08025-7c97-431b-b5b4-22c858cc25a2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:42.319302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08025-7c97-431b-b5b4-22c858cc25a2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:42.322537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce21f65-47dc-46f2-bb2b-171f5c8834e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:42.323174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce21f65-47dc-46f2-bb2b-171f5c8834e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:42.323457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce21f65-47dc-46f2-bb2b-171f5c8834e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:42.323735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce21f65-47dc-46f2-bb2b-171f5c8834e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:42.324748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce21f65-47dc-46f2-bb2b-171f5c8834e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:42.326970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce21f65-47dc-46f2-bb2b-171f5c8834e0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.499618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:42.507183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:42.507183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:42.514560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 853/1722] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:42 2022] POST /identity/v3/users => generated 287 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:42.520928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce21f65-47dc-46f2-bb2b-171f5c8834e0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:42.550492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce21f65-47dc-46f2-bb2b-171f5c8834e0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:42.551150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70d955-cb3d-48e3-8eec-032c20bdfcf4 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:42.576540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:42.578998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863453b4-dca6-4f0f-883d-48fe7405d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:42.580547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863453b4-dca6-4f0f-883d-48fe7405d54e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:42.584152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863453b4-dca6-4f0f-883d-48fe7405d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:42.584282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:42.584282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:42.584282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] PATH_INFO: `/v3/projects/15cd998e049e43649c15285fcc5eb570` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:42.588874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863453b4-dca6-4f0f-883d-48fe7405d54e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:42.591039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863453b4-dca6-4f0f-883d-48fe7405d54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:42.593181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cd998e049e43649c15285fcc5eb570)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:42.605907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863453b4-dca6-4f0f-883d-48fe7405d54e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.622211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.660160 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 854/1723] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:42 2022] GET /identity/v3/roles => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:42.664696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863453b4-dca6-4f0f-883d-48fe7405d54e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:42.701915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863453b4-dca6-4f0f-883d-48fe7405d54e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:42.725817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160175b5-2547-4e4c-868b-247a947e8a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:42.730614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160175b5-2547-4e4c-868b-247a947e8a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:42.733879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160175b5-2547-4e4c-868b-247a947e8a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:42.735254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160175b5-2547-4e4c-868b-247a947e8a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:42.742577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160175b5-2547-4e4c-868b-247a947e8a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:42.749021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160175b5-2547-4e4c-868b-247a947e8a9a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.793520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 855/1724] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:42 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:42.807376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160175b5-2547-4e4c-868b-247a947e8a9a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:42.830893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160175b5-2547-4e4c-868b-247a947e8a9a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:42.853019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472e174-222e-48b1-9f83-d6c72b048c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:42.855876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e174-222e-48b1-9f83-d6c72b048c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:42.862136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e174-222e-48b1-9f83-d6c72b048c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:42.862683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e174-222e-48b1-9f83-d6c72b048c87 admin admin] PATH_INFO: `/v3/projects/6a8e7b49b6ee491eb536614555e6758f/users/754166c3ca9c4b4185c2f8a087957478/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:42.909687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472e174-222e-48b1-9f83-d6c72b048c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8e7b49b6ee491eb536614555e6758f, user_id=754166c3ca9c4b4185c2f8a087957478, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:42.915840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472e174-222e-48b1-9f83-d6c72b048c87 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:42.919564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cd998e049e43649c15285fcc5eb570', 'request_id': 'req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:43.010059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cd998e049e43649c15285fcc5eb570', 'request_id': 'req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:43.032388 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cd998e049e43649c15285fcc5eb570', 'request_id': 'req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:43.057835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 856/1725] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:42 2022] PUT /identity/v3/projects/6a8e7b49b6ee491eb536614555e6758f/users/754166c3ca9c4b4185c2f8a087957478/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:43.064500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da0e3-e689-4ead-aa08-855b1abafee8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:43.064791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da0e3-e689-4ead-aa08-855b1abafee8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:43.069583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da0e3-e689-4ead-aa08-855b1abafee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:43.070506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] The token cache is being invalidate because project 15cd998e049e43649c15285fcc5eb570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:43.072070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:43.076936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2b0cc3cc-6ae4-40da-aa14-ed021ee9ab54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:43.082218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 870/1726] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:42 2022] DELETE /identity/v3/projects/15cd998e049e43649c15285fcc5eb570 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:43.088554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e36e9-d0ce-4066-9ddc-90fac038602e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:43.090094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e36e9-d0ce-4066-9ddc-90fac038602e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:43.090094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e36e9-d0ce-4066-9ddc-90fac038602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:43.177611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f02e36e9-d0ce-4066-9ddc-90fac038602e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:43.179627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f02e36e9-d0ce-4066-9ddc-90fac038602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:43.191826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8a5da0e3-e689-4ead-aa08-855b1abafee8 None None] MFA Rules not processed for user `754166c3ca9c4b4185c2f8a087957478`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:43.195648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8a5da0e3-e689-4ead-aa08-855b1abafee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:43.356728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 857/1727] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:43.357905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da0e3-e689-4ead-aa08-855b1abafee8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:43.360130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8a5da0e3-e689-4ead-aa08-855b1abafee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:43.498950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 871/1728] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:43.510110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4077c05-2322-4b5b-87f9-56a51b1a6cda None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:43.510521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4077c05-2322-4b5b-87f9-56a51b1a6cda None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:43.510805 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4077c05-2322-4b5b-87f9-56a51b1a6cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:43.544973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d4077c05-2322-4b5b-87f9-56a51b1a6cda None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:43.548397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d4077c05-2322-4b5b-87f9-56a51b1a6cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:43.577603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 872/1729] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:43.582321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4077c05-2322-4b5b-87f9-56a51b1a6cda None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:43.595396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da0e3-e689-4ead-aa08-855b1abafee8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:43.611763 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4077c05-2322-4b5b-87f9-56a51b1a6cda None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:43.618469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92835341-54df-44cb-9a9c-0a7a91a8ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:43.619025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92835341-54df-44cb-9a9c-0a7a91a8ae19 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:43.620831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92835341-54df-44cb-9a9c-0a7a91a8ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:43.621075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92835341-54df-44cb-9a9c-0a7a91a8ae19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:43.624566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92835341-54df-44cb-9a9c-0a7a91a8ae19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:43.626320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:43.626996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:43.627278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:43.627702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:43.628391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:43.628661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:43.633496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:43.635169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92835341-54df-44cb-9a9c-0a7a91a8ae19 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:43.663454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 873/1730] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:43.665598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:43.690851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87fcc1-776f-4526-86c9-0aa9efdc4929 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:43.705537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aede7-3502-40f1-9e35-06f7100c9a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:43.717443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aede7-3502-40f1-9e35-06f7100c9a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:43.717927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aede7-3502-40f1-9e35-06f7100c9a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:43.718281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aede7-3502-40f1-9e35-06f7100c9a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:43.719177 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aede7-3502-40f1-9e35-06f7100c9a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:43.721516 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aede7-3502-40f1-9e35-06f7100c9a0d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:43.730092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:43.803885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 858/1731] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:43 2022] POST /identity/v3/projects => generated 372 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:43.808042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92835341-54df-44cb-9a9c-0a7a91a8ae19 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:43.836894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 874/1732] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:43 2022] POST /identity/v3/projects => generated 404 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:43.841342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aede7-3502-40f1-9e35-06f7100c9a0d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:44.063897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92835341-54df-44cb-9a9c-0a7a91a8ae19 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:44.087213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aede7-3502-40f1-9e35-06f7100c9a0d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:44.090937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf3ba-31ce-4b67-8b2e-f77fd0482c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:44.091812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf3ba-31ce-4b67-8b2e-f77fd0482c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:44.092225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf3ba-31ce-4b67-8b2e-f77fd0482c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:44.092679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf3ba-31ce-4b67-8b2e-f77fd0482c68 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:44.093534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf3ba-31ce-4b67-8b2e-f77fd0482c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:44.096087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf3ba-31ce-4b67-8b2e-f77fd0482c68 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:44.107317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da046fa-e824-4edc-a487-8a2960c230ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:44.108088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da046fa-e824-4edc-a487-8a2960c230ba admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:44.108480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da046fa-e824-4edc-a487-8a2960c230ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:44.108783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da046fa-e824-4edc-a487-8a2960c230ba admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:44.109558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da046fa-e824-4edc-a487-8a2960c230ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:44.117714 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da046fa-e824-4edc-a487-8a2960c230ba admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:44.271557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 875/1733] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:43 2022] POST /identity/v3/users => generated 303 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:44.277861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c872-2a61-4af6-921e-71ffadadb639 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:44.277861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c872-2a61-4af6-921e-71ffadadb639 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:44.277861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964c872-2a61-4af6-921e-71ffadadb639 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:44.278395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 859/1734] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:43 2022] POST /identity/v3/users => generated 293 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:44.279857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf3ba-31ce-4b67-8b2e-f77fd0482c68 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:44.289845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 876/1735] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:12:44 2022] GET /identity => generated 271 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:12:44.290729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964c872-2a61-4af6-921e-71ffadadb639 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:44.299002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf3ba-31ce-4b67-8b2e-f77fd0482c68 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:44.326569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964c872-2a61-4af6-921e-71ffadadb639 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:44.337594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74716899-3291-44db-a9aa-cad9e2ad8c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:44.338472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cfa6e-3d33-4554-9da2-35ed06dd5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:44.338849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74716899-3291-44db-a9aa-cad9e2ad8c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:44.339281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74716899-3291-44db-a9aa-cad9e2ad8c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:44.339683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74716899-3291-44db-a9aa-cad9e2ad8c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:44.340606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74716899-3291-44db-a9aa-cad9e2ad8c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:44.342567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74716899-3291-44db-a9aa-cad9e2ad8c2b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:44.343978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cfa6e-3d33-4554-9da2-35ed06dd5007 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:44.348383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cfa6e-3d33-4554-9da2-35ed06dd5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:44.349143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cfa6e-3d33-4554-9da2-35ed06dd5007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:44.356443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cfa6e-3d33-4554-9da2-35ed06dd5007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:44.358171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cfa6e-3d33-4554-9da2-35ed06dd5007 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:44.394415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 877/1736] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:44 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:44.396229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc114720-82c0-470f-a885-99ee86b6102c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:44.405545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc114720-82c0-470f-a885-99ee86b6102c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:44.406049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc114720-82c0-470f-a885-99ee86b6102c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:44.417975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 860/1737] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:44 2022] GET /identity/v3/roles => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:44.422524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cfa6e-3d33-4554-9da2-35ed06dd5007 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:44.462407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cfa6e-3d33-4554-9da2-35ed06dd5007 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:44.463682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cc114720-82c0-470f-a885-99ee86b6102c None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:44.465009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cc114720-82c0-470f-a885-99ee86b6102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:44.473461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e87a17-aea1-465d-9849-332f0ee39112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:44.475461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e87a17-aea1-465d-9849-332f0ee39112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:44.476723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e87a17-aea1-465d-9849-332f0ee39112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:44.477372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e87a17-aea1-465d-9849-332f0ee39112 admin admin] PATH_INFO: `/v3/projects/0be1c437a3e24860bbe6ef5641ac0aa4/users/bd15a65906ff49aaa47a0677876d41f4/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:44.524624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e87a17-aea1-465d-9849-332f0ee39112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be1c437a3e24860bbe6ef5641ac0aa4, user_id=bd15a65906ff49aaa47a0677876d41f4, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:44.529527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e87a17-aea1-465d-9849-332f0ee39112 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:44.667181 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 861/1738] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:44 2022] PUT /identity/v3/projects/0be1c437a3e24860bbe6ef5641ac0aa4/users/bd15a65906ff49aaa47a0677876d41f4/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:44.691140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e87a17-aea1-465d-9849-332f0ee39112 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:44.734548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:44.753904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 878/1739] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:12:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:44.757471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc114720-82c0-470f-a885-99ee86b6102c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:44.788873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc114720-82c0-470f-a885-99ee86b6102c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:44.931497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27a1f7-b7a1-49e3-9e3e-d01721360216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:44.933025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a1f7-b7a1-49e3-9e3e-d01721360216 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:44.933815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a1f7-b7a1-49e3-9e3e-d01721360216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:44.934553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a1f7-b7a1-49e3-9e3e-d01721360216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:44.935276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27a1f7-b7a1-49e3-9e3e-d01721360216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:44.937123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27a1f7-b7a1-49e3-9e3e-d01721360216 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:45.014333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 879/1740] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:44 2022] GET /identity/v3/roles => generated 1427 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:45.019881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868784-c667-4fbf-8c43-28416eeb4564 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.022736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868784-c667-4fbf-8c43-28416eeb4564 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.023050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868784-c667-4fbf-8c43-28416eeb4564 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.027472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e87a17-aea1-465d-9849-332f0ee39112 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:45.029142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 880/1741] 10.222.0.123 () {54 vars in 917 bytes} [Thu May 26 18:12:45 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:12:45.036679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868784-c667-4fbf-8c43-28416eeb4564 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:45.043645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ad74-5d4e-4034-9873-c04d0383b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:45.044801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ad74-5d4e-4034-9873-c04d0383b599 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.045231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ad74-5d4e-4034-9873-c04d0383b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.045648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ad74-5d4e-4034-9873-c04d0383b599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.046623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0ad74-5d4e-4034-9873-c04d0383b599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:45.061528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0ad74-5d4e-4034-9873-c04d0383b599 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:45.083535 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 862/1742] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:44 2022] GET /identity/v3/roles => generated 1427 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:45.086087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735e8c-3d45-458d-b264-9b6e2bcbce2a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.086676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735e8c-3d45-458d-b264-9b6e2bcbce2a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.087108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735e8c-3d45-458d-b264-9b6e2bcbce2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.106361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868784-c667-4fbf-8c43-28416eeb4564 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:45.121291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477bd2c-1347-46f1-b914-b4c61846c0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:45.122345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477bd2c-1347-46f1-b914-b4c61846c0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.124644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477bd2c-1347-46f1-b914-b4c61846c0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.124941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477bd2c-1347-46f1-b914-b4c61846c0dd admin admin] PATH_INFO: `/v3/projects/0be1c437a3e24860bbe6ef5641ac0aa4/users/bd15a65906ff49aaa47a0677876d41f4/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.129451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477bd2c-1347-46f1-b914-b4c61846c0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be1c437a3e24860bbe6ef5641ac0aa4, user_id=bd15a65906ff49aaa47a0677876d41f4, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:45.134518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6f735e8c-3d45-458d-b264-9b6e2bcbce2a None None] MFA Rules not processed for user `66452133fd6348109e3065303947ecce`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:45.136139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6f735e8c-3d45-458d-b264-9b6e2bcbce2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:45.155861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477bd2c-1347-46f1-b914-b4c61846c0dd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:45.221930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 881/1743] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:45 2022] PUT /identity/v3/projects/0be1c437a3e24860bbe6ef5641ac0aa4/users/bd15a65906ff49aaa47a0677876d41f4/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:45.226783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477bd2c-1347-46f1-b914-b4c61846c0dd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:45.296716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 863/1744] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:45.299461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc451-9926-416c-8ca2-5f2ec0c11a3f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.299900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc451-9926-416c-8ca2-5f2ec0c11a3f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.300358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc451-9926-416c-8ca2-5f2ec0c11a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.347157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f2ddc451-9926-416c-8ca2-5f2ec0c11a3f None None] MFA Rules not processed for user `bd15a65906ff49aaa47a0677876d41f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:45.349546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f2ddc451-9926-416c-8ca2-5f2ec0c11a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:45.448225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477bd2c-1347-46f1-b914-b4c61846c0dd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:45.454088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc9969-bc03-44e0-ab98-f455e851b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:45.455746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc9969-bc03-44e0-ab98-f455e851b472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.456063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc9969-bc03-44e0-ab98-f455e851b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.456519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc9969-bc03-44e0-ab98-f455e851b472 admin admin] PATH_INFO: `/v3/projects/043a00d2277745169a5410b2d572b706/users/53639ebd69b44c469a6d7a6693d65db6/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.480928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc9969-bc03-44e0-ab98-f455e851b472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043a00d2277745169a5410b2d572b706, user_id=53639ebd69b44c469a6d7a6693d65db6, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:45.491728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc9969-bc03-44e0-ab98-f455e851b472 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:45.544182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 864/1745] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:45.545696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddc451-9926-416c-8ca2-5f2ec0c11a3f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:45.547678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f2ddc451-9926-416c-8ca2-5f2ec0c11a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:45.635576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 882/1746] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:45 2022] PUT /identity/v3/projects/043a00d2277745169a5410b2d572b706/users/53639ebd69b44c469a6d7a6693d65db6/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:45.635576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077960c4-e876-42f2-97d2-12e0fdf0f509 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.635576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077960c4-e876-42f2-97d2-12e0fdf0f509 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.636149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077960c4-e876-42f2-97d2-12e0fdf0f509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.695955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-077960c4-e876-42f2-97d2-12e0fdf0f509 None None] MFA Rules not processed for user `ebdb2f4338f842f19f1cba1be13597c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:45.699305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-077960c4-e876-42f2-97d2-12e0fdf0f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:45.710011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddc451-9926-416c-8ca2-5f2ec0c11a3f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:45.834298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df6ea2-cdd9-44df-8f24-2e5193b677c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:45.836180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6ea2-cdd9-44df-8f24-2e5193b677c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.837064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6ea2-cdd9-44df-8f24-2e5193b677c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.838092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6ea2-cdd9-44df-8f24-2e5193b677c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.862132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df6ea2-cdd9-44df-8f24-2e5193b677c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:45.863803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 883/1747] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:45.865212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df6ea2-cdd9-44df-8f24-2e5193b677c2 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:45.870108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077960c4-e876-42f2-97d2-12e0fdf0f509 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:45.877267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-077960c4-e876-42f2-97d2-12e0fdf0f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:45.886697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 865/1748] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:45.894240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b7e3-c82d-4bab-9e4d-187edcb6081f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:45.897269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b7e3-c82d-4bab-9e4d-187edcb6081f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:45.901024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b7e3-c82d-4bab-9e4d-187edcb6081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:45.976424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ad56b7e3-c82d-4bab-9e4d-187edcb6081f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:45.980652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ad56b7e3-c82d-4bab-9e4d-187edcb6081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:46.217732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077960c4-e876-42f2-97d2-12e0fdf0f509 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:46.236751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:46.236751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:46.236751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:46.236751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:46.267087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 866/1749] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:46.267087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b7e3-c82d-4bab-9e4d-187edcb6081f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:46.268447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ad56b7e3-c82d-4bab-9e4d-187edcb6081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:46.402943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:46.404637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:46.419179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 884/1750] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:46.420705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:46.442652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:46.456209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b7e3-c82d-4bab-9e4d-187edcb6081f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:46.497131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:46.498202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579e71-1f45-4647-8911-ef8167b87333 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:46.500487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:46.502459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:46.502702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:46.503811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:46.504620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:46.504969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:46.509340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:46.517328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:46.518878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:46.532705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 885/1751] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:46.556187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:46.565180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:46.611442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 867/1752] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:46.663177 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:46.665140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:46.687796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6e83-a33f-407e-a16c-1d538a9a8ecc service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:46.700896 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:46.702166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:46.702414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:46.702750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] PATH_INFO: `/v3/users/659b99b34b134eb7844038e965eea4d3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:46.704750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] RBAC: Authorizing `identity:delete_user(user_id=659b99b34b134eb7844038e965eea4d3)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:46.706934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:46.797799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:46.799824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:46.824955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bad37-6287-4cf4-9a16-733dfa7d94c2 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:46.832666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4ee53-43e8-4a61-994f-0b31466ad29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:46.833527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ee53-43e8-4a61-994f-0b31466ad29a service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:46.834215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ee53-43e8-4a61-994f-0b31466ad29a service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:46.834775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ee53-43e8-4a61-994f-0b31466ad29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:47.042377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659b99b34b134eb7844038e965eea4d3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:47.043161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659b99b34b134eb7844038e965eea4d3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:47.044719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659b99b34b134eb7844038e965eea4d3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:47.123302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4ee53-43e8-4a61-994f-0b31466ad29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:47.132720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4ee53-43e8-4a61-994f-0b31466ad29a service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:47.135342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659b99b34b134eb7844038e965eea4d3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:47.159983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659b99b34b134eb7844038e965eea4d3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:47.180948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 868/1753] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:47.261839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 886/1754] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:46 2022] DELETE /identity/v3/users/659b99b34b134eb7844038e965eea4d3 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:47.267272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ab17-9d00-4614-b0ed-811b93bcdcdc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:47.267272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ab17-9d00-4614-b0ed-811b93bcdcdc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:47.267272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ab17-9d00-4614-b0ed-811b93bcdcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:47.313086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-57f2ab17-9d00-4614-b0ed-811b93bcdcdc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:47.314867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-57f2ab17-9d00-4614-b0ed-811b93bcdcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:47.464135 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 869/1755] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:47.493093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:47.494599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:47.557852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:47.567285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ca06-19f4-46cd-aedd-f72856c6d870 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:47.567285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ca06-19f4-46cd-aedd-f72856c6d870 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:47.567285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ca06-19f4-46cd-aedd-f72856c6d870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:47.596118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-92d7ca06-19f4-46cd-aedd-f72856c6d870 None None] MFA Rules not processed for user `95a7cc3020514672a7ab872cfdeabef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:47.598002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-92d7ca06-19f4-46cd-aedd-f72856c6d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:47.638588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06499966-064e-4d76-a9fc-d7c760cb815b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:47.657210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:47.657878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:47.658157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:47.658426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:47.679475 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:47.681117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:47.727113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 887/1756] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:47.776797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 870/1757] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:48.509788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:49.043220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:49.044704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:49.076869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73084ef-2a0e-4500-9ae1-1a406ae73c83 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:49.086858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:49.102676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:49.105168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:49.105628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] PATH_INFO: `/v3/projects/73156195dc0f49618c797644cf19662e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:49.109797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=73156195dc0f49618c797644cf19662e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:49.116911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:49.395065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73156195dc0f49618c797644cf19662e', 'request_id': 'req-355c3742-e024-40f6-ab91-d06a5617d1ee'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:49.550326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73156195dc0f49618c797644cf19662e', 'request_id': 'req-355c3742-e024-40f6-ab91-d06a5617d1ee'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:49.563216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73156195dc0f49618c797644cf19662e', 'request_id': 'req-355c3742-e024-40f6-ab91-d06a5617d1ee'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:49.614477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] The token cache is being invalidate because project 73156195dc0f49618c797644cf19662e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:49.614791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:49.618159 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:49.625125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 888/1758] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:49 2022] DELETE /identity/v3/projects/73156195dc0f49618c797644cf19662e => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:49.629252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ca06-19f4-46cd-aedd-f72856c6d870 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:49.652920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ca06-19f4-46cd-aedd-f72856c6d870 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:49.798833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:49.800212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:49.800555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:49.812348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] PATH_INFO: `/v3/users/8f6490a1d1824c32817f0bbbc5cd8c8e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:49.812348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6490a1d1824c32817f0bbbc5cd8c8e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:49.812643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:50.125584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6490a1d1824c32817f0bbbc5cd8c8e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:50.129104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6490a1d1824c32817f0bbbc5cd8c8e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:50.130049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6490a1d1824c32817f0bbbc5cd8c8e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:50.150367 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:50.169898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6490a1d1824c32817f0bbbc5cd8c8e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:50.193457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-12a45e2b-6719-499d-8166-dcfd84c553fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6490a1d1824c32817f0bbbc5cd8c8e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:50.373783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 871/1759] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:49 2022] DELETE /identity/v3/users/8f6490a1d1824c32817f0bbbc5cd8c8e => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:12:51.983154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:51.985293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:52.008876 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c3742-e024-40f6-ab91-d06a5617d1ee admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:52.072828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59737793-5956-43f9-ba12-6a558117e816 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:52.073344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59737793-5956-43f9-ba12-6a558117e816 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:52.073415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59737793-5956-43f9-ba12-6a558117e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:52.122393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-59737793-5956-43f9-ba12-6a558117e816 None None] MFA Rules not processed for user `09ad128756994ea0b6333d0694b840b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:52.123942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-59737793-5956-43f9-ba12-6a558117e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:52.163228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:52.227974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:52.229621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:52.229944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:52.231749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] PATH_INFO: `/v3/projects/9b9d696758214fb7bc81aeed99fd14b1` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:52.237525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9d696758214fb7bc81aeed99fd14b1)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:52.238294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:52.306379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 872/1760] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:52.307830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3189-6f5e-4c9a-be62-7902dc94b762 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:52.313831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3189-6f5e-4c9a-be62-7902dc94b762 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:52.316832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3189-6f5e-4c9a-be62-7902dc94b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:52.388194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-562c3189-6f5e-4c9a-be62-7902dc94b762 None None] MFA Rules not processed for user `53639ebd69b44c469a6d7a6693d65db6`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:52.389635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-562c3189-6f5e-4c9a-be62-7902dc94b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:52.539159 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9d696758214fb7bc81aeed99fd14b1', 'request_id': 'req-78335234-c91b-4812-951a-1e744fb461fd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:52.543250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 873/1761] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:52.557292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c3189-6f5e-4c9a-be62-7902dc94b762 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:52.565596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-562c3189-6f5e-4c9a-be62-7902dc94b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:52.609182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c3189-6f5e-4c9a-be62-7902dc94b762 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:52.745302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e4079-614f-44b0-a7a6-40bd3ab7d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:52.745713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4079-614f-44b0-a7a6-40bd3ab7d192 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:52.745713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4079-614f-44b0-a7a6-40bd3ab7d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:52.746176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4079-614f-44b0-a7a6-40bd3ab7d192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:52.746816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e4079-614f-44b0-a7a6-40bd3ab7d192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:52.749064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e4079-614f-44b0-a7a6-40bd3ab7d192 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:52.769209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9d696758214fb7bc81aeed99fd14b1', 'request_id': 'req-78335234-c91b-4812-951a-1e744fb461fd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:52.780158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9d696758214fb7bc81aeed99fd14b1', 'request_id': 'req-78335234-c91b-4812-951a-1e744fb461fd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:52.819453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] The token cache is being invalidate because project 9b9d696758214fb7bc81aeed99fd14b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:52.820161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:52.824706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:52.829741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 889/1762] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:51 2022] DELETE /identity/v3/projects/9b9d696758214fb7bc81aeed99fd14b1 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:52.830975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:52.835864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:52.854888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78335234-c91b-4812-951a-1e744fb461fd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:52.869934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:52.870839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:52.871125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:52.871403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] PATH_INFO: `/v3/users/3b8e872b187a4d7f9e770dbd6ef89dbc` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:52.873317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8e872b187a4d7f9e770dbd6ef89dbc)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:52.886144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:52.924845 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 874/1763] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:52 2022] POST /identity/v3/projects => generated 406 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:52.928632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8854aee-15f4-4c01-831e-d75c417ffb8f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:52.931961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8854aee-15f4-4c01-831e-d75c417ffb8f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:52.932492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8854aee-15f4-4c01-831e-d75c417ffb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:52.982525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e8854aee-15f4-4c01-831e-d75c417ffb8f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:52.982525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e8854aee-15f4-4c01-831e-d75c417ffb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:53.157423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 875/1764] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:53.158592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8854aee-15f4-4c01-831e-d75c417ffb8f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:53.160263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e8854aee-15f4-4c01-831e-d75c417ffb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:53.202665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8854aee-15f4-4c01-831e-d75c417ffb8f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:53.213684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8e872b187a4d7f9e770dbd6ef89dbc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:53.214960 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db2105-352a-4b25-8f00-fcbe02fe7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:53.215761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2105-352a-4b25-8f00-fcbe02fe7883 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:53.216142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2105-352a-4b25-8f00-fcbe02fe7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:53.216573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2105-352a-4b25-8f00-fcbe02fe7883 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:53.217093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8e872b187a4d7f9e770dbd6ef89dbc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:53.217586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db2105-352a-4b25-8f00-fcbe02fe7883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:53.218237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8e872b187a4d7f9e770dbd6ef89dbc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:53.220950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db2105-352a-4b25-8f00-fcbe02fe7883 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:53.245127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8e872b187a4d7f9e770dbd6ef89dbc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:53.260721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8e872b187a4d7f9e770dbd6ef89dbc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:53.362815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 876/1765] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:53 2022] POST /identity/v3/users => generated 310 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:53.364489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ee2c4-e1d5-4a9e-99df-4ec81bcac102 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:53.367468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ee2c4-e1d5-4a9e-99df-4ec81bcac102 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:53.367963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ee2c4-e1d5-4a9e-99df-4ec81bcac102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:53.414873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3c7ee2c4-e1d5-4a9e-99df-4ec81bcac102 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:53.417764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c7ee2c4-e1d5-4a9e-99df-4ec81bcac102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:53.421615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 890/1766] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:52 2022] DELETE /identity/v3/users/3b8e872b187a4d7f9e770dbd6ef89dbc => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:53.422712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:53.426701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:53.572483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 877/1767] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:53.577034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368587b-85cb-471f-af9f-b89fb1de85cf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:53.578651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368587b-85cb-471f-af9f-b89fb1de85cf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:53.579914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368587b-85cb-471f-af9f-b89fb1de85cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:53.626095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5368587b-85cb-471f-af9f-b89fb1de85cf None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:53.633214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5368587b-85cb-471f-af9f-b89fb1de85cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:53.645532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28b5b2-b4ab-4f48-8c09-11f652413062 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:53.647389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 878/1768] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:53.648484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368587b-85cb-471f-af9f-b89fb1de85cf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:53.667473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368587b-85cb-471f-af9f-b89fb1de85cf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:53.668380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485358ca-c2e5-4cb3-819f-ae47a054b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:53.669289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485358ca-c2e5-4cb3-819f-ae47a054b36e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:53.669686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485358ca-c2e5-4cb3-819f-ae47a054b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:53.669971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485358ca-c2e5-4cb3-819f-ae47a054b36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:53.671049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485358ca-c2e5-4cb3-819f-ae47a054b36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:53.671801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:53.672633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:53.673068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485358ca-c2e5-4cb3-819f-ae47a054b36e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:53.673326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:53.673721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:53.674589 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:53.675158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:53.677206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:53.698561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 879/1769] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:53.699949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:53.702212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:53.716223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:53.724791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 891/1770] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:53 2022] GET /identity/v3/roles => generated 1427 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:53.726755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485358ca-c2e5-4cb3-819f-ae47a054b36e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:53.750330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485358ca-c2e5-4cb3-819f-ae47a054b36e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:53.767568 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6204ed-0a80-4d8b-a709-eb6442ff9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:53.767568 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6204ed-0a80-4d8b-a709-eb6442ff9a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:53.767808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6204ed-0a80-4d8b-a709-eb6442ff9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:53.767901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6204ed-0a80-4d8b-a709-eb6442ff9a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:53.768613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6204ed-0a80-4d8b-a709-eb6442ff9a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:53.770868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6204ed-0a80-4d8b-a709-eb6442ff9a11 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:53.813638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22e534-c1b0-4aa4-a547-369da233e225 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:53.829499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3626-3a1c-4fe6-880f-7cf8a33bec44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:53.830193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3626-3a1c-4fe6-880f-7cf8a33bec44 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:53.830554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3626-3a1c-4fe6-880f-7cf8a33bec44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:53.830875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3626-3a1c-4fe6-880f-7cf8a33bec44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:53.844200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3626-3a1c-4fe6-880f-7cf8a33bec44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:53.847086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3626-3a1c-4fe6-880f-7cf8a33bec44 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:53.874289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 880/1771] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:53.876575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3626-3a1c-4fe6-880f-7cf8a33bec44 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:53.893050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3626-3a1c-4fe6-880f-7cf8a33bec44 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:53.909623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 892/1772] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:53 2022] POST /identity/v3/projects => generated 386 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:53.913783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbea559-b4c6-431d-8a29-a4b59cc24956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:53.914507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6204ed-0a80-4d8b-a709-eb6442ff9a11 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:53.915613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea559-b4c6-431d-8a29-a4b59cc24956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:53.915868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea559-b4c6-431d-8a29-a4b59cc24956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:53.916156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbea559-b4c6-431d-8a29-a4b59cc24956 admin admin] PATH_INFO: `/v3/projects/0587c1c277a84fbe8d46c802a73d794c/users/253e0b3462ac454980aaaf69097f7d53/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:53.939867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbea559-b4c6-431d-8a29-a4b59cc24956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0587c1c277a84fbe8d46c802a73d794c, user_id=253e0b3462ac454980aaaf69097f7d53, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:53.946267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbea559-b4c6-431d-8a29-a4b59cc24956 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:54.029795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6204ed-0a80-4d8b-a709-eb6442ff9a11 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:54.033278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333a678-6416-4991-81d5-071abe26508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:54.034054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333a678-6416-4991-81d5-071abe26508a admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.034402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333a678-6416-4991-81d5-071abe26508a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.034675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333a678-6416-4991-81d5-071abe26508a admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.035612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333a678-6416-4991-81d5-071abe26508a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:54.039916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333a678-6416-4991-81d5-071abe26508a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:54.098177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 881/1773] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:53 2022] PUT /identity/v3/projects/0587c1c277a84fbe8d46c802a73d794c/users/253e0b3462ac454980aaaf69097f7d53/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:54.102120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbea559-b4c6-431d-8a29-a4b59cc24956 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:54.188509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbea559-b4c6-431d-8a29-a4b59cc24956 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:54.193390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae897-6361-4aa7-9348-89fc51ee7554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:54.195393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae897-6361-4aa7-9348-89fc51ee7554 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.195733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae897-6361-4aa7-9348-89fc51ee7554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.196083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae897-6361-4aa7-9348-89fc51ee7554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.197607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cae897-6361-4aa7-9348-89fc51ee7554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:54.199973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cae897-6361-4aa7-9348-89fc51ee7554 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:54.223918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 893/1774] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:53 2022] POST /identity/v3/users => generated 294 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:54.226444 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333a678-6416-4991-81d5-071abe26508a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:54.231182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 882/1775] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:54 2022] GET /identity/v3/roles => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:12:54.232172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae897-6361-4aa7-9348-89fc51ee7554 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:54.259792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333a678-6416-4991-81d5-071abe26508a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:54.268189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae897-6361-4aa7-9348-89fc51ee7554 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:54.290112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d12511-6c27-44f3-84eb-2946c60c7ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:54.290112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12511-6c27-44f3-84eb-2946c60c7ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.290112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12511-6c27-44f3-84eb-2946c60c7ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.290112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12511-6c27-44f3-84eb-2946c60c7ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.292840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d12511-6c27-44f3-84eb-2946c60c7ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:54.292840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d12511-6c27-44f3-84eb-2946c60c7ad5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:54.297668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdd89-ef47-439c-a23b-0cf23b1b6a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:54.299082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdd89-ef47-439c-a23b-0cf23b1b6a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.299082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdd89-ef47-439c-a23b-0cf23b1b6a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.299303 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdd89-ef47-439c-a23b-0cf23b1b6a9b admin admin] PATH_INFO: `/v3/projects/0587c1c277a84fbe8d46c802a73d794c/users/253e0b3462ac454980aaaf69097f7d53/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.302103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afdd89-ef47-439c-a23b-0cf23b1b6a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0587c1c277a84fbe8d46c802a73d794c, user_id=253e0b3462ac454980aaaf69097f7d53, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:54.305808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afdd89-ef47-439c-a23b-0cf23b1b6a9b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:54.341424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 883/1776] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:54 2022] PUT /identity/v3/projects/0587c1c277a84fbe8d46c802a73d794c/users/253e0b3462ac454980aaaf69097f7d53/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:54.367053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 894/1777] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:54 2022] GET /identity/v3/roles => generated 1427 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:54.370247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdd89-ef47-439c-a23b-0cf23b1b6a9b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:54.556496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdd89-ef47-439c-a23b-0cf23b1b6a9b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:54.572690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837197c-1097-4d88-a77d-37375efd3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:54.577131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837197c-1097-4d88-a77d-37375efd3e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.578305 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837197c-1097-4d88-a77d-37375efd3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.579746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837197c-1097-4d88-a77d-37375efd3e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.580737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837197c-1097-4d88-a77d-37375efd3e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:54.592432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837197c-1097-4d88-a77d-37375efd3e87 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:54.607753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 884/1778] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:54 2022] GET /identity/v3/roles => generated 1427 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:54.609062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d12511-6c27-44f3-84eb-2946c60c7ad5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:54.625732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d12511-6c27-44f3-84eb-2946c60c7ad5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:54.664644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd20c33-0b4e-4dc3-b569-abd60903e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:54.665528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20c33-0b4e-4dc3-b569-abd60903e569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.665821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20c33-0b4e-4dc3-b569-abd60903e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.666230 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20c33-0b4e-4dc3-b569-abd60903e569 admin admin] PATH_INFO: `/v3/projects/8d4def37e9cf4566a4a63d32013fc40f/users/873285978d2b4719a48f7c87fd992d30/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.706900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd20c33-0b4e-4dc3-b569-abd60903e569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4def37e9cf4566a4a63d32013fc40f, user_id=873285978d2b4719a48f7c87fd992d30, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:54.711254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd20c33-0b4e-4dc3-b569-abd60903e569 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:54.936228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 895/1779] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:54 2022] PUT /identity/v3/projects/8d4def37e9cf4566a4a63d32013fc40f/users/873285978d2b4719a48f7c87fd992d30/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:54.947588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602f39-b8d3-4d7e-b206-aabf97d61f67 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.947868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602f39-b8d3-4d7e-b206-aabf97d61f67 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.948133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602f39-b8d3-4d7e-b206-aabf97d61f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:55.002508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3f602f39-b8d3-4d7e-b206-aabf97d61f67 None None] MFA Rules not processed for user `873285978d2b4719a48f7c87fd992d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:55.004120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3f602f39-b8d3-4d7e-b206-aabf97d61f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:55.101317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 885/1780] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:55.105787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd20c33-0b4e-4dc3-b569-abd60903e569 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:55.185997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd20c33-0b4e-4dc3-b569-abd60903e569 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:55.190946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52742cb-757d-47d7-bd42-e0d9c23c684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:55.191619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52742cb-757d-47d7-bd42-e0d9c23c684e admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:55.191900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52742cb-757d-47d7-bd42-e0d9c23c684e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:55.192172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52742cb-757d-47d7-bd42-e0d9c23c684e admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:55.192910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52742cb-757d-47d7-bd42-e0d9c23c684e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:55.195099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52742cb-757d-47d7-bd42-e0d9c23c684e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:55.227070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f602f39-b8d3-4d7e-b206-aabf97d61f67 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:55.228894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3f602f39-b8d3-4d7e-b206-aabf97d61f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:55.264148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f602f39-b8d3-4d7e-b206-aabf97d61f67 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:55.273144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:55.273144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:55.273144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:55.273144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] PATH_INFO: `/v3/projects/1cb3d7826b1e42c794f565ea40fefc86` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:55.273653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb3d7826b1e42c794f565ea40fefc86)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:55.275626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:55.362779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 896/1781] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:55 2022] POST /identity/v3/projects => generated 388 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:55.366708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52742cb-757d-47d7-bd42-e0d9c23c684e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:55.436074 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb3d7826b1e42c794f565ea40fefc86', 'request_id': 'req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:55.443013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52742cb-757d-47d7-bd42-e0d9c23c684e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:55.524872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb3d7826b1e42c794f565ea40fefc86', 'request_id': 'req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:55.537234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb3d7826b1e42c794f565ea40fefc86', 'request_id': 'req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:55.544583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:55.546975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:55.547270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:55.549467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:55.549467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:55.551341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:55.563929 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] The token cache is being invalidate because project 1cb3d7826b1e42c794f565ea40fefc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:55.564324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:55.576561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:55.582345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 886/1782] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:55 2022] DELETE /identity/v3/projects/1cb3d7826b1e42c794f565ea40fefc86 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:55.587316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:55.591382 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:55.611069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e7dc-29d8-40c6-ab41-1acf8c2ba93d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:55.616464 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:55.617359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:55.617637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:55.617909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] PATH_INFO: `/v3/users/5c3b3048e3eb415cb1f362df1915aa73` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:55.619119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3b3048e3eb415cb1f362df1915aa73)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:55.621246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:55.767848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 897/1783] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:55 2022] POST /identity/v3/users => generated 295 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:55.772417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:55.775978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:55.803662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0a55a-0587-4b8d-87b2-de06e03e0a64 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:55.814854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24ac8-d239-400d-baa0-2581d53bef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:55.822362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24ac8-d239-400d-baa0-2581d53bef98 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:55.822362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24ac8-d239-400d-baa0-2581d53bef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:55.822362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce24ac8-d239-400d-baa0-2581d53bef98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:55.822362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce24ac8-d239-400d-baa0-2581d53bef98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:55.822909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce24ac8-d239-400d-baa0-2581d53bef98 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:55.844355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 898/1784] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:55 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:12:55.856658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24ac8-d239-400d-baa0-2581d53bef98 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:55.888486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce24ac8-d239-400d-baa0-2581d53bef98 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:55.902119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73455f7-962e-4faf-81d7-86a6747af6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:55.902875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73455f7-962e-4faf-81d7-86a6747af6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:55.903483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73455f7-962e-4faf-81d7-86a6747af6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:55.903913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73455f7-962e-4faf-81d7-86a6747af6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:55.905105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73455f7-962e-4faf-81d7-86a6747af6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:55.911865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73455f7-962e-4faf-81d7-86a6747af6c4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:55.934414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 899/1785] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:55 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:55.936674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73455f7-962e-4faf-81d7-86a6747af6c4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:55.949976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73455f7-962e-4faf-81d7-86a6747af6c4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:55.955012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:55.956882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:55.957379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:55.957854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] PATH_INFO: `/v3/projects/fccb7362857e4bddb03e9cb7b4b5cde8/users/9f24cad9aba84f0f8fee19f1ade6c9f6/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:55.958387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3b3048e3eb415cb1f362df1915aa73'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:55.960959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3b3048e3eb415cb1f362df1915aa73'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:55.961624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3b3048e3eb415cb1f362df1915aa73'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:55.980261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3b3048e3eb415cb1f362df1915aa73'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:56.000049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a25f0de-de07-4469-913a-c6f1edcf6ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3b3048e3eb415cb1f362df1915aa73'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:56.002806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccb7362857e4bddb03e9cb7b4b5cde8, user_id=9f24cad9aba84f0f8fee19f1ade6c9f6, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:56.020545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:56.158328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 887/1786] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:12:55 2022] DELETE /identity/v3/users/5c3b3048e3eb415cb1f362df1915aa73 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:56.206064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:56.220963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 900/1787] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:55 2022] PUT /identity/v3/projects/fccb7362857e4bddb03e9cb7b4b5cde8/users/9f24cad9aba84f0f8fee19f1ade6c9f6/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:56.230292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726c8f4-9766-4a3d-be0f-51d20ac3af83 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:56.230815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726c8f4-9766-4a3d-be0f-51d20ac3af83 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:56.230899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726c8f4-9766-4a3d-be0f-51d20ac3af83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:56.259590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7726c8f4-9766-4a3d-be0f-51d20ac3af83 None None] MFA Rules not processed for user `9f24cad9aba84f0f8fee19f1ade6c9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:56.260867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7726c8f4-9766-4a3d-be0f-51d20ac3af83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:56.328886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 888/1788] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:56.333510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:56.337038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:56.411649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d11d7-4473-4795-9766-370fa05b99a2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:56.429639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9149-7f6c-4496-a03e-dc21f23cdba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:56.430322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9149-7f6c-4496-a03e-dc21f23cdba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:56.430611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9149-7f6c-4496-a03e-dc21f23cdba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:56.430888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9149-7f6c-4496-a03e-dc21f23cdba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:56.431605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae9149-7f6c-4496-a03e-dc21f23cdba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:56.433589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae9149-7f6c-4496-a03e-dc21f23cdba6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:56.634218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 901/1789] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:56 2022] POST /identity/v3/projects => generated 386 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:56.635352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726c8f4-9766-4a3d-be0f-51d20ac3af83 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:56.658923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726c8f4-9766-4a3d-be0f-51d20ac3af83 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:56.692756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:56.731210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:56.731990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:56.732240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:56.732611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:56.737448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:56.737448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:56.875070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 889/1790] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:56 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:56.878685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9149-7f6c-4496-a03e-dc21f23cdba6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:56.893153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9149-7f6c-4496-a03e-dc21f23cdba6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:56.922696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a93a9b-a0cd-4648-991a-74de7ee3a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:56.927947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a93a9b-a0cd-4648-991a-74de7ee3a4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:56.928180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a93a9b-a0cd-4648-991a-74de7ee3a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:56.928506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a93a9b-a0cd-4648-991a-74de7ee3a4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:56.931813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a93a9b-a0cd-4648-991a-74de7ee3a4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:56.933609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a93a9b-a0cd-4648-991a-74de7ee3a4c3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:56.956053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:56.957804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:56.999644 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 902/1791] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:56 2022] GET /identity/v3/roles => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:12:57.001806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49201085-c148-44f2-a081-3d030bee9a1d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:57.008828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a93a9b-a0cd-4648-991a-74de7ee3a4c3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:57.015837 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:57.022704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.022704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.023028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] PATH_INFO: `/v3/projects/800366482449454884502e402ebd6edd` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.026129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=800366482449454884502e402ebd6edd)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:57.042573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:57.054875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a93a9b-a0cd-4648-991a-74de7ee3a4c3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:57.090248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cd048-cc31-4ddf-b9b0-5e1e5974c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:57.091157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd048-cc31-4ddf-b9b0-5e1e5974c771 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.091456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd048-cc31-4ddf-b9b0-5e1e5974c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.092164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cd048-cc31-4ddf-b9b0-5e1e5974c771 admin admin] PATH_INFO: `/v3/projects/1fa74428c834492783652ecf71744a9b/users/03797829e5ee4c57bbf69bbfe0268002/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.143259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cd048-cc31-4ddf-b9b0-5e1e5974c771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa74428c834492783652ecf71744a9b, user_id=03797829e5ee4c57bbf69bbfe0268002, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:57.146787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cd048-cc31-4ddf-b9b0-5e1e5974c771 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:57.297662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 903/1792] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:57 2022] PUT /identity/v3/projects/1fa74428c834492783652ecf71744a9b/users/03797829e5ee4c57bbf69bbfe0268002/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:57.299154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a951b-41f2-4aa5-ba88-8f7a8f1298af None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.304630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a951b-41f2-4aa5-ba88-8f7a8f1298af None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.304630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a951b-41f2-4aa5-ba88-8f7a8f1298af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.363110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800366482449454884502e402ebd6edd', 'request_id': 'req-2106dc27-0a3c-425d-b866-6eecca650266'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:57.408702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c08a951b-41f2-4aa5-ba88-8f7a8f1298af None None] MFA Rules not processed for user `253e0b3462ac454980aaaf69097f7d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:57.409953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c08a951b-41f2-4aa5-ba88-8f7a8f1298af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:57.470310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800366482449454884502e402ebd6edd', 'request_id': 'req-2106dc27-0a3c-425d-b866-6eecca650266'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:57.489458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800366482449454884502e402ebd6edd', 'request_id': 'req-2106dc27-0a3c-425d-b866-6eecca650266'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:57.509843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] The token cache is being invalidate because project 800366482449454884502e402ebd6edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:12:57.510137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:57.510808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:12:57.512910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 890/1793] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:12:56 2022] DELETE /identity/v3/projects/800366482449454884502e402ebd6edd => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:12:57.513830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:57.516934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:57.559576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 904/1794] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:57 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:57.568128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454534-0a50-4181-aee5-6a08ddc7ce0b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.569301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454534-0a50-4181-aee5-6a08ddc7ce0b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.569817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454534-0a50-4181-aee5-6a08ddc7ce0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.595996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c7454534-0a50-4181-aee5-6a08ddc7ce0b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:57.597252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c7454534-0a50-4181-aee5-6a08ddc7ce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:57.682431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106dc27-0a3c-425d-b866-6eecca650266 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:57.688256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd0953-648a-45cc-93cd-50aeaa236850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:57.690090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0953-648a-45cc-93cd-50aeaa236850 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.690090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0953-648a-45cc-93cd-50aeaa236850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.690090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0953-648a-45cc-93cd-50aeaa236850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.690395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd0953-648a-45cc-93cd-50aeaa236850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:57.692176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd0953-648a-45cc-93cd-50aeaa236850 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:57.713162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 891/1795] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:57 2022] GET /identity/v3/roles => generated 1427 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:57.715133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd0953-648a-45cc-93cd-50aeaa236850 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:57.737611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd0953-648a-45cc-93cd-50aeaa236850 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:57.744456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48e7bb-3707-42b9-9cc0-c4ee382514e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:57.746722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e7bb-3707-42b9-9cc0-c4ee382514e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.747901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e7bb-3707-42b9-9cc0-c4ee382514e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.748432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48e7bb-3707-42b9-9cc0-c4ee382514e2 admin admin] PATH_INFO: `/v3/projects/1fa74428c834492783652ecf71744a9b/users/03797829e5ee4c57bbf69bbfe0268002/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.750935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48e7bb-3707-42b9-9cc0-c4ee382514e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa74428c834492783652ecf71744a9b, user_id=03797829e5ee4c57bbf69bbfe0268002, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:57.754615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48e7bb-3707-42b9-9cc0-c4ee382514e2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:57.780127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 892/1796] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:57 2022] PUT /identity/v3/projects/1fa74428c834492783652ecf71744a9b/users/03797829e5ee4c57bbf69bbfe0268002/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:57.782309 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c8d7-5dec-4a6c-b7e4-55c7fd9cac77 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.782602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c8d7-5dec-4a6c-b7e4-55c7fd9cac77 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.782931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c8d7-5dec-4a6c-b7e4-55c7fd9cac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.783530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 905/1797] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:57.792604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ae79-ff6b-43c5-88db-66c15e07b25b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.792890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ae79-ff6b-43c5-88db-66c15e07b25b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.793195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ae79-ff6b-43c5-88db-66c15e07b25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.843045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9866ae79-ff6b-43c5-88db-66c15e07b25b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:57.847701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9866ae79-ff6b-43c5-88db-66c15e07b25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:57.857733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d7a5c8d7-5dec-4a6c-b7e4-55c7fd9cac77 None None] MFA Rules not processed for user `03797829e5ee4c57bbf69bbfe0268002`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:57.860277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d7a5c8d7-5dec-4a6c-b7e4-55c7fd9cac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:57.951997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 906/1798] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:57.956619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ae79-ff6b-43c5-88db-66c15e07b25b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:57.972771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ae79-ff6b-43c5-88db-66c15e07b25b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:57.986998 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:57.987870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.988090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.988388 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.989157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:12:57.989442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:57.993385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:58.009284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 893/1799] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:58.020165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 907/1800] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:12:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:12:58.022614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c8d7-5dec-4a6c-b7e4-55c7fd9cac77 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:58.025040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d7a5c8d7-5dec-4a6c-b7e4-55c7fd9cac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:58.027224 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:58.060455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2217e-6332-44f2-94d5-56f96edca1bb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:58.070202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18d96-0da8-40a9-b0d3-81f9b8129bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:58.070914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18d96-0da8-40a9-b0d3-81f9b8129bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:58.071194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18d96-0da8-40a9-b0d3-81f9b8129bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:58.071468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18d96-0da8-40a9-b0d3-81f9b8129bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:58.072162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18d96-0da8-40a9-b0d3-81f9b8129bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:58.075060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18d96-0da8-40a9-b0d3-81f9b8129bd2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:58.117613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c8d7-5dec-4a6c-b7e4-55c7fd9cac77 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:58.121998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba01740-c64b-42c3-a75f-0c57a9d1a3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:58.122881 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba01740-c64b-42c3-a75f-0c57a9d1a3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:58.123269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba01740-c64b-42c3-a75f-0c57a9d1a3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:58.123668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba01740-c64b-42c3-a75f-0c57a9d1a3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:58.136605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba01740-c64b-42c3-a75f-0c57a9d1a3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:58.138275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba01740-c64b-42c3-a75f-0c57a9d1a3c1 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:58.152906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 894/1801] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:58.229132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 908/1802] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:58 2022] POST /identity/v3/projects => generated 364 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:12:58.229348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba01740-c64b-42c3-a75f-0c57a9d1a3c1 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:58.241997 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba01740-c64b-42c3-a75f-0c57a9d1a3c1 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:58.345149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960c03-91e3-4ad5-a07e-2701c2e5daba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:58.346078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960c03-91e3-4ad5-a07e-2701c2e5daba admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:58.346365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960c03-91e3-4ad5-a07e-2701c2e5daba admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:58.346647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960c03-91e3-4ad5-a07e-2701c2e5daba admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:58.347457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960c03-91e3-4ad5-a07e-2701c2e5daba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:58.359163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960c03-91e3-4ad5-a07e-2701c2e5daba admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:58.684777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 895/1803] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:58 2022] POST /identity/v3/users => generated 283 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:58.693207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18d96-0da8-40a9-b0d3-81f9b8129bd2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:58.719616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18d96-0da8-40a9-b0d3-81f9b8129bd2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:58.735242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c1d7-4868-4101-81c4-76a46692c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:58.736939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c1d7-4868-4101-81c4-76a46692c1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:58.742109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c1d7-4868-4101-81c4-76a46692c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:58.742109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c1d7-4868-4101-81c4-76a46692c1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:58.742109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c1d7-4868-4101-81c4-76a46692c1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:58.742109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c1d7-4868-4101-81c4-76a46692c1c8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:58.756062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 909/1804] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:58 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:12:58.760630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960c03-91e3-4ad5-a07e-2701c2e5daba admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:58.773791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960c03-91e3-4ad5-a07e-2701c2e5daba admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:58.779093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea2d72-2edd-47f2-9d5b-ece9439bc917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:58.780059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea2d72-2edd-47f2-9d5b-ece9439bc917 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:58.780579 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea2d72-2edd-47f2-9d5b-ece9439bc917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:58.780952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea2d72-2edd-47f2-9d5b-ece9439bc917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:58.781930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea2d72-2edd-47f2-9d5b-ece9439bc917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:58.805896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea2d72-2edd-47f2-9d5b-ece9439bc917 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:58.823248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 896/1805] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:12:58 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:12:58.831663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c1d7-4868-4101-81c4-76a46692c1c8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:58.851416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c1d7-4868-4101-81c4-76a46692c1c8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:58.867791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2d545-5fd6-4334-addc-773318dd7a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:58.868855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2d545-5fd6-4334-addc-773318dd7a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:58.869087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2d545-5fd6-4334-addc-773318dd7a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:58.869411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2d545-5fd6-4334-addc-773318dd7a06 admin admin] PATH_INFO: `/v3/projects/1511c5871a894e48a326d13267fb538c/users/76f30168518e4e0bacbbe9c558240e6c/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:58.891865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2d545-5fd6-4334-addc-773318dd7a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1511c5871a894e48a326d13267fb538c, user_id=76f30168518e4e0bacbbe9c558240e6c, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:58.901938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2d545-5fd6-4334-addc-773318dd7a06 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:59.015216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 910/1806] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:12:58 2022] PUT /identity/v3/projects/1511c5871a894e48a326d13267fb538c/users/76f30168518e4e0bacbbe9c558240e6c/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:12:59.029409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2579375-1857-4ec8-b422-57f200377dff None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:59.029743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2579375-1857-4ec8-b422-57f200377dff None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:59.030011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2579375-1857-4ec8-b422-57f200377dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:59.061971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e2579375-1857-4ec8-b422-57f200377dff None None] MFA Rules not processed for user `76f30168518e4e0bacbbe9c558240e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:59.063528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e2579375-1857-4ec8-b422-57f200377dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:59.147703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 897/1807] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:12:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:59.152635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2d545-5fd6-4334-addc-773318dd7a06 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:59.195103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:59.222580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2d545-5fd6-4334-addc-773318dd7a06 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:59.229174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2672-e2cd-45d3-936f-85926ef3cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:59.229836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2672-e2cd-45d3-936f-85926ef3cec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:59.230114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2672-e2cd-45d3-936f-85926ef3cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:59.230496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2672-e2cd-45d3-936f-85926ef3cec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:59.231121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add2672-e2cd-45d3-936f-85926ef3cec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:59.233414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add2672-e2cd-45d3-936f-85926ef3cec1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:59.324280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acec5-a2dc-4e5a-bc1b-a4597e8beb45 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:59.324605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acec5-a2dc-4e5a-bc1b-a4597e8beb45 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:59.324847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acec5-a2dc-4e5a-bc1b-a4597e8beb45 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:59.326466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 898/1808] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:12:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:12:59.369202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff2259-59cc-4167-9450-01826a07f8ca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:59.369794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff2259-59cc-4167-9450-01826a07f8ca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:59.370410 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff2259-59cc-4167-9450-01826a07f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:59.383255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 911/1809] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:12:59 2022] POST /identity/v3/projects => generated 364 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:12:59.387476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2672-e2cd-45d3-936f-85926ef3cec1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:59.410854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8bff2259-59cc-4167-9450-01826a07f8ca None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:59.412087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8bff2259-59cc-4167-9450-01826a07f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:59.550399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:59.572703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 899/1810] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:12:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:12:59.579219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2672-e2cd-45d3-936f-85926ef3cec1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:59.584226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff2259-59cc-4167-9450-01826a07f8ca None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:59.585947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8bff2259-59cc-4167-9450-01826a07f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:59.586359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea51e-3007-46b8-a1be-fbaaa149b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:59.587349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea51e-3007-46b8-a1be-fbaaa149b165 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:59.587654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea51e-3007-46b8-a1be-fbaaa149b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:59.588069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea51e-3007-46b8-a1be-fbaaa149b165 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:59.589073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bea51e-3007-46b8-a1be-fbaaa149b165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:59.591171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bea51e-3007-46b8-a1be-fbaaa149b165 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:59.599552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff2259-59cc-4167-9450-01826a07f8ca None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:59.607122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a58c7-bb2f-4cdb-9b4b-9c6b08f7941e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:59.609508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a58c7-bb2f-4cdb-9b4b-9c6b08f7941e service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:59.609508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a58c7-bb2f-4cdb-9b4b-9c6b08f7941e service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:59.609508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a58c7-bb2f-4cdb-9b4b-9c6b08f7941e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:59.621694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a58c7-bb2f-4cdb-9b4b-9c6b08f7941e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:59.623755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a58c7-bb2f-4cdb-9b4b-9c6b08f7941e service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:59.652532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 900/1811] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:12:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:00.460773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 912/1812] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:12:59 2022] POST /identity/v3/users => generated 289 bytes in 1074 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:00.472646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a58c7-bb2f-4cdb-9b4b-9c6b08f7941e service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:00.487145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a58c7-bb2f-4cdb-9b4b-9c6b08f7941e service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:00.498680 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145b15-24e4-4d3f-901d-dbad90c8371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:00.499621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145b15-24e4-4d3f-901d-dbad90c8371f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:00.499903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145b15-24e4-4d3f-901d-dbad90c8371f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:00.500178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145b15-24e4-4d3f-901d-dbad90c8371f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:00.500950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145b15-24e4-4d3f-901d-dbad90c8371f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:00.502585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145b15-24e4-4d3f-901d-dbad90c8371f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:00.520187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 901/1813] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:00 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:00.525239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea51e-3007-46b8-a1be-fbaaa149b165 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:00.544378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea51e-3007-46b8-a1be-fbaaa149b165 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:00.550472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca8319-47de-4e6d-a18d-8be8b6660411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:00.551442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca8319-47de-4e6d-a18d-8be8b6660411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:00.551667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca8319-47de-4e6d-a18d-8be8b6660411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:00.551950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca8319-47de-4e6d-a18d-8be8b6660411 admin admin] PATH_INFO: `/v3/projects/0c58d2caa472428bb4b4fb5fe1cc7ea3/users/d0d1f4ff45614d49b9b5486bd81541b5/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:00.569193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca8319-47de-4e6d-a18d-8be8b6660411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c58d2caa472428bb4b4fb5fe1cc7ea3, user_id=d0d1f4ff45614d49b9b5486bd81541b5, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:00.573183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca8319-47de-4e6d-a18d-8be8b6660411 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:00.870280 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 913/1814] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:00 2022] PUT /identity/v3/projects/0c58d2caa472428bb4b4fb5fe1cc7ea3/users/d0d1f4ff45614d49b9b5486bd81541b5/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:00.870368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145b15-24e4-4d3f-901d-dbad90c8371f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:00.870368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145b15-24e4-4d3f-901d-dbad90c8371f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:00.961440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:00.962717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:00.963776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:00.964263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:00.965234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:00.967092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:00.998657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 902/1815] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:00 2022] GET /identity/v3/roles => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:01.000024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca8319-47de-4e6d-a18d-8be8b6660411 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:01.014396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:01.017192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca8319-47de-4e6d-a18d-8be8b6660411 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:01.017756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:01.022974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb738-34e0-4ec1-8e17-689c86ddbe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:01.025221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb738-34e0-4ec1-8e17-689c86ddbe23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.025584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb738-34e0-4ec1-8e17-689c86ddbe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.026416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb738-34e0-4ec1-8e17-689c86ddbe23 admin admin] PATH_INFO: `/v3/projects/0c58d2caa472428bb4b4fb5fe1cc7ea3/users/d0d1f4ff45614d49b9b5486bd81541b5/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.028760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb738-34e0-4ec1-8e17-689c86ddbe23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c58d2caa472428bb4b4fb5fe1cc7ea3, user_id=d0d1f4ff45614d49b9b5486bd81541b5, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:01.032551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb738-34e0-4ec1-8e17-689c86ddbe23 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:01.074889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 914/1816] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:00 2022] PUT /identity/v3/projects/0c58d2caa472428bb4b4fb5fe1cc7ea3/users/d0d1f4ff45614d49b9b5486bd81541b5/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:01.074889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62cedc-0a95-4bf5-9820-a4fc1615d7c7 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.074889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62cedc-0a95-4bf5-9820-a4fc1615d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.074889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62cedc-0a95-4bf5-9820-a4fc1615d7c7 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.092012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 915/1817] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:13:01 2022] GET /identity => generated 271 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:13:01.094902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe549-a29a-4855-90fc-092dd12c7917 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.098155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe549-a29a-4855-90fc-092dd12c7917 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.105212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe549-a29a-4855-90fc-092dd12c7917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.161538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ee6f7-1418-4d4d-8656-b578c174cf56 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:01.176023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d20fe549-a29a-4855-90fc-092dd12c7917 None None] MFA Rules not processed for user `d0d1f4ff45614d49b9b5486bd81541b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:01.179535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d20fe549-a29a-4855-90fc-092dd12c7917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:01.325045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:01.326224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.328164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.329461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.334747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:01.378221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 916/1818] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:01.378868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86751f-c90d-4715-8138-9560535db5d9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.380452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86751f-c90d-4715-8138-9560535db5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.380749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86751f-c90d-4715-8138-9560535db5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.430149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9e86751f-c90d-4715-8138-9560535db5d9 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:01.431431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9e86751f-c90d-4715-8138-9560535db5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:01.552972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:01.554495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:01.585331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 903/1819] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:01.585331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:01.595795 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda218-bce8-42fe-9916-299b470ba397 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:01.601314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdb205-4e48-4aef-8a96-a198d7006fe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:01.603226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb205-4e48-4aef-8a96-a198d7006fe3 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.603226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb205-4e48-4aef-8a96-a198d7006fe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.603414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb205-4e48-4aef-8a96-a198d7006fe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.633218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdb205-4e48-4aef-8a96-a198d7006fe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:01.634514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 917/1820] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:13:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:01.634993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdb205-4e48-4aef-8a96-a198d7006fe3 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:01.662511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 904/1821] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:01.915861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8252-63b4-4666-8439-75350e0a8c4c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.923903 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8252-63b4-4666-8439-75350e0a8c4c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.924505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e8252-63b4-4666-8439-75350e0a8c4c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.932685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 918/1822] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:13:01 2022] GET /identity => generated 271 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:13:01.941277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae663d46-08c8-40b1-992c-c2feb61318c3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.941558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae663d46-08c8-40b1-992c-c2feb61318c3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.941956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae663d46-08c8-40b1-992c-c2feb61318c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.958662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8252-63b4-4666-8439-75350e0a8c4c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:01.961880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-707e8252-63b4-4666-8439-75350e0a8c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:02.008235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ae663d46-08c8-40b1-992c-c2feb61318c3 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:02.009404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e8252-63b4-4666-8439-75350e0a8c4c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:02.009514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ae663d46-08c8-40b1-992c-c2feb61318c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:02.022759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007997ed-3cf2-4908-af13-67355c004498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:02.023933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007997ed-3cf2-4908-af13-67355c004498 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:02.024223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007997ed-3cf2-4908-af13-67355c004498 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:02.024527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007997ed-3cf2-4908-af13-67355c004498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:02.039222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 905/1823] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:13:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:02.040169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae663d46-08c8-40b1-992c-c2feb61318c3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:02.050612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007997ed-3cf2-4908-af13-67355c004498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:02.052647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007997ed-3cf2-4908-af13-67355c004498 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:02.060334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae663d46-08c8-40b1-992c-c2feb61318c3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:02.065953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149e51a-0a94-4031-838b-814d56221ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:02.067061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e51a-0a94-4031-838b-814d56221ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:02.067710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e51a-0a94-4031-838b-814d56221ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:02.068178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149e51a-0a94-4031-838b-814d56221ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:02.075979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 919/1824] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:02.170245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149e51a-0a94-4031-838b-814d56221ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:02.171833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149e51a-0a94-4031-838b-814d56221ee7 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:02.185138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 906/1825] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:02.231134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdaba-ce96-40e7-808d-201c4e3297c7 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:02.232021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdaba-ce96-40e7-808d-201c4e3297c7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:02.232429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdaba-ce96-40e7-808d-201c4e3297c7 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:02.234061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 920/1826] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:13:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:13:02.266492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b245d-43a7-4d20-ab8b-c32b9b0886fd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:02.266833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b245d-43a7-4d20-ab8b-c32b9b0886fd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:02.267215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b245d-43a7-4d20-ab8b-c32b9b0886fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:02.300006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-db0b245d-43a7-4d20-ab8b-c32b9b0886fd None None] MFA Rules not processed for user `dfe692e2ebff459f89835258db961125`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:02.301402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-db0b245d-43a7-4d20-ab8b-c32b9b0886fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:02.388035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 907/1827] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:13:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:02.422656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cdaba-ce96-40e7-808d-201c4e3297c7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:02.449497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cdaba-ce96-40e7-808d-201c4e3297c7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:02.454629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:02.455433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:02.455718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:02.456034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:02.466794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:02.469046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:02.480139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 921/1828] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:02.534601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b245d-43a7-4d20-ab8b-c32b9b0886fd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:02.536166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-db0b245d-43a7-4d20-ab8b-c32b9b0886fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:02.538543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:02.545995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:02.573762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdf80-d923-4f8e-9a4d-e39d55cf2c5a service placement] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:02.582922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9133f-a62b-4ed3-9895-192a5ebba44a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:02.584679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9133f-a62b-4ed3-9895-192a5ebba44a service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:02.585456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9133f-a62b-4ed3-9895-192a5ebba44a service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:02.586979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9133f-a62b-4ed3-9895-192a5ebba44a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:02.599452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9133f-a62b-4ed3-9895-192a5ebba44a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:02.601516 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9133f-a62b-4ed3-9895-192a5ebba44a service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:02.629106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 922/1829] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:02.642961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b245d-43a7-4d20-ab8b-c32b9b0886fd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:02.649879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:02.651650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:02.652157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:02.652663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] PATH_INFO: `/v3/users/53639ebd69b44c469a6d7a6693d65db6` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:02.654202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=53639ebd69b44c469a6d7a6693d65db6)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:02.656943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:02.698770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:02.912328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53639ebd69b44c469a6d7a6693d65db6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:02.914114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53639ebd69b44c469a6d7a6693d65db6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:02.916507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53639ebd69b44c469a6d7a6693d65db6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:02.943439 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53639ebd69b44c469a6d7a6693d65db6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:02.963386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53639ebd69b44c469a6d7a6693d65db6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:03.104092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 908/1830] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:02 2022] DELETE /identity/v3/users/53639ebd69b44c469a6d7a6693d65db6 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:03.710400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9133f-a62b-4ed3-9895-192a5ebba44a service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:03.722497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9133f-a62b-4ed3-9895-192a5ebba44a service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:03.783423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:03.784407 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:03.784683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:03.784950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] PATH_INFO: `/v3/projects/043a00d2277745169a5410b2d572b706` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:03.786163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043a00d2277745169a5410b2d572b706)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:03.788691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:03.907582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043a00d2277745169a5410b2d572b706', 'request_id': 'req-ef63e431-6bae-440c-8cb4-088c88ae05d0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.005063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043a00d2277745169a5410b2d572b706', 'request_id': 'req-ef63e431-6bae-440c-8cb4-088c88ae05d0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.013434 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043a00d2277745169a5410b2d572b706', 'request_id': 'req-ef63e431-6bae-440c-8cb4-088c88ae05d0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.027112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] The token cache is being invalidate because project 043a00d2277745169a5410b2d572b706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:04.027397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.028220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.029825 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 923/1831] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:03 2022] DELETE /identity/v3/projects/043a00d2277745169a5410b2d572b706 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:04.034121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:04.036242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:04.050788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f9df8-95b8-4ca9-90a4-89368ae93bbb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:04.115491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:04.116457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:04.116743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:04.117020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] PATH_INFO: `/v3/users/253e0b3462ac454980aaaf69097f7d53` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:04.118216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253e0b3462ac454980aaaf69097f7d53)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:04.120241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:04.255703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:04.426351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253e0b3462ac454980aaaf69097f7d53'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.427056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253e0b3462ac454980aaaf69097f7d53'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.427666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253e0b3462ac454980aaaf69097f7d53'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.441038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253e0b3462ac454980aaaf69097f7d53'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.450197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-768ec4b8-cec6-41b4-a0ef-701eb2577ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253e0b3462ac454980aaaf69097f7d53'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:04.680479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 909/1832] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:04 2022] DELETE /identity/v3/users/253e0b3462ac454980aaaf69097f7d53 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:04.794186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:05.107045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:05.109886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:05.151039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63e431-6bae-440c-8cb4-088c88ae05d0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:05.217707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:05.218577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:05.218866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:05.219146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] PATH_INFO: `/v3/projects/0587c1c277a84fbe8d46c802a73d794c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:05.221030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0587c1c277a84fbe8d46c802a73d794c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:05.222972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:05.336749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0587c1c277a84fbe8d46c802a73d794c', 'request_id': 'req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:05.489588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0587c1c277a84fbe8d46c802a73d794c', 'request_id': 'req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:05.497729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0587c1c277a84fbe8d46c802a73d794c', 'request_id': 'req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:05.510043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] The token cache is being invalidate because project 0587c1c277a84fbe8d46c802a73d794c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:05.510336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:05.511026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c4aeffb-b0fd-470f-8f12-958f8f1213ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:05.513326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 924/1833] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:05 2022] DELETE /identity/v3/projects/0587c1c277a84fbe8d46c802a73d794c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:05.518743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ff28a-89f5-475d-a41c-e836a2e576fe None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:05.519239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ff28a-89f5-475d-a41c-e836a2e576fe None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:05.519861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ff28a-89f5-475d-a41c-e836a2e576fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:05.540035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d46ff28a-89f5-475d-a41c-e836a2e576fe None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:05.541569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d46ff28a-89f5-475d-a41c-e836a2e576fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:05.609749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 910/1834] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:05.619181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a9d4c-3ca8-4a9f-aa0b-757e7323b8d8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:05.619684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a9d4c-3ca8-4a9f-aa0b-757e7323b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:05.620043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a9d4c-3ca8-4a9f-aa0b-757e7323b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:05.646239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c31a9d4c-3ca8-4a9f-aa0b-757e7323b8d8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:05.647784 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c31a9d4c-3ca8-4a9f-aa0b-757e7323b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:05.659895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 925/1835] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:05.664483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ff28a-89f5-475d-a41c-e836a2e576fe None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:05.674813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ff28a-89f5-475d-a41c-e836a2e576fe None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:05.680720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:05.681502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:05.681790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:05.682061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:05.682794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:05.683112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:05.684787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:05.711490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a9d4c-3ca8-4a9f-aa0b-757e7323b8d8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:05.722823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 911/1836] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:05.726385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a9d4c-3ca8-4a9f-aa0b-757e7323b8d8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:05.736830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7379-39e4-431a-ada0-7ac77d694bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:05.737864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7379-39e4-431a-ada0-7ac77d694bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:05.738333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7379-39e4-431a-ada0-7ac77d694bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:05.738860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7379-39e4-431a-ada0-7ac77d694bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:05.739739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d7379-39e4-431a-ada0-7ac77d694bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:05.742150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d7379-39e4-431a-ada0-7ac77d694bc4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:05.930532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 926/1837] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:05 2022] POST /identity/v3/projects => generated 408 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:05.934909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:05.946365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af341a9a-c6e9-45d5-a05c-95bc407fd963 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:06.084428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c8f8-2195-46b8-b4d5-b5ff57bb0d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:06.084428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c8f8-2195-46b8-b4d5-b5ff57bb0d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.084428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c8f8-2195-46b8-b4d5-b5ff57bb0d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.089100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:06.089910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c8f8-2195-46b8-b4d5-b5ff57bb0d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.091400 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c8f8-2195-46b8-b4d5-b5ff57bb0d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:06.097814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c8f8-2195-46b8-b4d5-b5ff57bb0d0e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:06.220505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 912/1838] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:05 2022] POST /identity/v3/users => generated 305 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:06.224481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7379-39e4-431a-ada0-7ac77d694bc4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:06.239804 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7379-39e4-431a-ada0-7ac77d694bc4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:06.246929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8c0f-8890-4747-bdc5-dd87e48d892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:06.247669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8c0f-8890-4747-bdc5-dd87e48d892d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.248096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8c0f-8890-4747-bdc5-dd87e48d892d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.248751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8c0f-8890-4747-bdc5-dd87e48d892d admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.249331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa8c0f-8890-4747-bdc5-dd87e48d892d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:06.251459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa8c0f-8890-4747-bdc5-dd87e48d892d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:06.263162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 927/1839] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:06 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:06.270909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c8f8-2195-46b8-b4d5-b5ff57bb0d0e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:06.281831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c8f8-2195-46b8-b4d5-b5ff57bb0d0e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:06.292498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e25624-3d44-47ae-8f68-9ec3de6f38d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:06.292690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25624-3d44-47ae-8f68-9ec3de6f38d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.292977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25624-3d44-47ae-8f68-9ec3de6f38d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.293264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25624-3d44-47ae-8f68-9ec3de6f38d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.294024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e25624-3d44-47ae-8f68-9ec3de6f38d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:06.295677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e25624-3d44-47ae-8f68-9ec3de6f38d0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:06.306320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 913/1840] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:06 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:06.311159 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8c0f-8890-4747-bdc5-dd87e48d892d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:06.321330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8c0f-8890-4747-bdc5-dd87e48d892d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:06.326197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef367-435c-47d5-9b80-d8899afad4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:06.327078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef367-435c-47d5-9b80-d8899afad4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.327360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef367-435c-47d5-9b80-d8899afad4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.327634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef367-435c-47d5-9b80-d8899afad4e4 admin admin] PATH_INFO: `/v3/projects/09f2daee4b5247e194d262b5f1dc891d/users/febac9846b4b4697b727c3458a96c5b8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.347359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbef367-435c-47d5-9b80-d8899afad4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f2daee4b5247e194d262b5f1dc891d, user_id=febac9846b4b4697b727c3458a96c5b8, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:06.347359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbef367-435c-47d5-9b80-d8899afad4e4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:06.458685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 928/1841] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:06 2022] PUT /identity/v3/projects/09f2daee4b5247e194d262b5f1dc891d/users/febac9846b4b4697b727c3458a96c5b8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:06.469483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdaca4-295c-4592-a3bb-15503c4d48a4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.469768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdaca4-295c-4592-a3bb-15503c4d48a4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.470041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdaca4-295c-4592-a3bb-15503c4d48a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.499151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-53fdaca4-295c-4592-a3bb-15503c4d48a4 None None] MFA Rules not processed for user `febac9846b4b4697b727c3458a96c5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:06.500415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-53fdaca4-295c-4592-a3bb-15503c4d48a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:06.574635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 914/1842] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:06.579205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef367-435c-47d5-9b80-d8899afad4e4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:06.651994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef367-435c-47d5-9b80-d8899afad4e4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:06.661951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d37cd-ccd5-46d5-9a14-6f99ad39b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:06.662814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d37cd-ccd5-46d5-9a14-6f99ad39b731 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.663103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d37cd-ccd5-46d5-9a14-6f99ad39b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.663378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d37cd-ccd5-46d5-9a14-6f99ad39b731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.664219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d37cd-ccd5-46d5-9a14-6f99ad39b731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:06.666244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d37cd-ccd5-46d5-9a14-6f99ad39b731 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:06.886393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdaca4-295c-4592-a3bb-15503c4d48a4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:06.901006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 929/1843] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:06 2022] POST /identity/v3/projects => generated 408 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:06.902813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdaca4-295c-4592-a3bb-15503c4d48a4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:06.977173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e36932-faef-4a0b-a11c-bebe74395d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:06.977860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36932-faef-4a0b-a11c-bebe74395d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.978145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36932-faef-4a0b-a11c-bebe74395d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.978427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36932-faef-4a0b-a11c-bebe74395d1b admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.979122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e36932-faef-4a0b-a11c-bebe74395d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:06.981152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e36932-faef-4a0b-a11c-bebe74395d1b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:07.162380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 915/1844] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:06 2022] POST /identity/v3/users => generated 311 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:07.167325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d37cd-ccd5-46d5-9a14-6f99ad39b731 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:07.182060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d37cd-ccd5-46d5-9a14-6f99ad39b731 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:07.188926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218dfc2-744b-49b0-b9bd-6d00baf1d707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:07.189914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218dfc2-744b-49b0-b9bd-6d00baf1d707 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:07.190482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218dfc2-744b-49b0-b9bd-6d00baf1d707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:07.191028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218dfc2-744b-49b0-b9bd-6d00baf1d707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:07.192066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218dfc2-744b-49b0-b9bd-6d00baf1d707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:07.194142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218dfc2-744b-49b0-b9bd-6d00baf1d707 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:07.217375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e36932-faef-4a0b-a11c-bebe74395d1b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:07.235743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e36932-faef-4a0b-a11c-bebe74395d1b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:07.236532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 930/1845] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:07 2022] GET /identity/v3/roles => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:07.246497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6234db7-e823-4667-b83d-a458b99ca2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:07.247458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6234db7-e823-4667-b83d-a458b99ca2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:07.247740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6234db7-e823-4667-b83d-a458b99ca2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:07.248015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6234db7-e823-4667-b83d-a458b99ca2e4 admin admin] PATH_INFO: `/v3/projects/32bab435d35c42d0922a3b5700dd1206/users/a6dcf089b94a402a9b095abcc177c382/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:07.287769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6234db7-e823-4667-b83d-a458b99ca2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bab435d35c42d0922a3b5700dd1206, user_id=a6dcf089b94a402a9b095abcc177c382, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:07.298820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6234db7-e823-4667-b83d-a458b99ca2e4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:07.443264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 916/1846] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:07 2022] PUT /identity/v3/projects/32bab435d35c42d0922a3b5700dd1206/users/a6dcf089b94a402a9b095abcc177c382/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:07.447129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218dfc2-744b-49b0-b9bd-6d00baf1d707 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:07.458619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218dfc2-744b-49b0-b9bd-6d00baf1d707 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:07.521082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58f439-4ec6-4bff-8404-938fb74873b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:07.521746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58f439-4ec6-4bff-8404-938fb74873b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:07.522147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58f439-4ec6-4bff-8404-938fb74873b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:07.522425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58f439-4ec6-4bff-8404-938fb74873b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:07.523135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58f439-4ec6-4bff-8404-938fb74873b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:07.524780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58f439-4ec6-4bff-8404-938fb74873b4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:07.534870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 931/1847] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:07 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:07.540112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6234db7-e823-4667-b83d-a458b99ca2e4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:07.550767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6234db7-e823-4667-b83d-a458b99ca2e4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:07.556346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:07.557258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:07.557542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:07.557816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] PATH_INFO: `/v3/projects/32bab435d35c42d0922a3b5700dd1206/users/a6dcf089b94a402a9b095abcc177c382/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:07.559783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bab435d35c42d0922a3b5700dd1206, user_id=a6dcf089b94a402a9b095abcc177c382, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:07.562497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:07.573357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 917/1848] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:07 2022] PUT /identity/v3/projects/32bab435d35c42d0922a3b5700dd1206/users/a6dcf089b94a402a9b095abcc177c382/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:07.583401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafbb3a-a7fe-4785-81c3-71c010ebdf7a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:07.583687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafbb3a-a7fe-4785-81c3-71c010ebdf7a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:07.583961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafbb3a-a7fe-4785-81c3-71c010ebdf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:07.611166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dbafbb3a-a7fe-4785-81c3-71c010ebdf7a None None] MFA Rules not processed for user `a6dcf089b94a402a9b095abcc177c382`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:07.612483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dbafbb3a-a7fe-4785-81c3-71c010ebdf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:07.666250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:07.668524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:07.681204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 932/1849] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:07 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:07.728275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b611f39-de56-48cc-b0a2-cda4ef6aee56 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:07.731939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:07.732628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:07.732898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:07.733186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:07.741520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:07.821156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:07.823192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:07.837052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 918/1850] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:07.870621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafbb3a-a7fe-4785-81c3-71c010ebdf7a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:07.872440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dbafbb3a-a7fe-4785-81c3-71c010ebdf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:07.893694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafbb3a-a7fe-4785-81c3-71c010ebdf7a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:07.900936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:07.901689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:07.902044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:07.913225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:07.914251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:07.915930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:07.926747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 933/1851] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:07 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:09.803162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:09.813952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2e226-fec4-4453-be40-1769ee633f5c service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:09.818064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:09.819315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:09.819830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:09.820175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:09.890769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:09.892527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:09.904807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 919/1852] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:09 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:10.818464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:11.974093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:13.913034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:14.830132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:15.505321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:15.506821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:15.589935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db360-5e22-4687-8d5e-64d0df1be76d service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:15.594808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:15.595746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:15.596180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:15.596573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] PATH_INFO: `/v3/users/873285978d2b4719a48f7c87fd992d30` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:15.597842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=873285978d2b4719a48f7c87fd992d30)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:15.599926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:15.706046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:15.708708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:15.729041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725b5c6-7eee-49d8-b285-58fc57aafe99 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:15.737249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:15.738175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:15.738460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:15.738738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] PATH_INFO: `/v3/users/76f30168518e4e0bacbbe9c558240e6c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:15.739948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f30168518e4e0bacbbe9c558240e6c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:15.742764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:15.873055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873285978d2b4719a48f7c87fd992d30'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:15.873833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873285978d2b4719a48f7c87fd992d30'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:15.874442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873285978d2b4719a48f7c87fd992d30'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:15.893143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873285978d2b4719a48f7c87fd992d30'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:15.898838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f6eb92e3-9f73-475e-9570-c2100d64bc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873285978d2b4719a48f7c87fd992d30'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:16.015187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 934/1853] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:15 2022] DELETE /identity/v3/users/873285978d2b4719a48f7c87fd992d30 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:16.017088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191742-5114-4dfc-9137-80cd7437c7b3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:16.017521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191742-5114-4dfc-9137-80cd7437c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:16.017939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191742-5114-4dfc-9137-80cd7437c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:16.030764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f30168518e4e0bacbbe9c558240e6c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:16.032246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f30168518e4e0bacbbe9c558240e6c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:16.033431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f30168518e4e0bacbbe9c558240e6c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:16.046335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6d191742-5114-4dfc-9137-80cd7437c7b3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:16.047550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6d191742-5114-4dfc-9137-80cd7437c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:16.048700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f30168518e4e0bacbbe9c558240e6c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:16.059151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c292eee6-89d8-4219-bf98-428b4e8d585c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f30168518e4e0bacbbe9c558240e6c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:16.107803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 935/1854] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:16.117341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d191742-5114-4dfc-9137-80cd7437c7b3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:16.118891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6d191742-5114-4dfc-9137-80cd7437c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:16.160343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 920/1855] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:15 2022] DELETE /identity/v3/users/76f30168518e4e0bacbbe9c558240e6c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:16.165243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c52a5-7be8-4f2c-87d9-e51674481b0a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:16.165527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c52a5-7be8-4f2c-87d9-e51674481b0a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:16.165802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c52a5-7be8-4f2c-87d9-e51674481b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:16.176491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d191742-5114-4dfc-9137-80cd7437c7b3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:16.183077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ce9c52a5-7be8-4f2c-87d9-e51674481b0a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:16.184274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ce9c52a5-7be8-4f2c-87d9-e51674481b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:16.228766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:16.229485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:16.229766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:16.230042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:16.268617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 921/1856] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:16.279084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c52a5-7be8-4f2c-87d9-e51674481b0a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:16.291097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c52a5-7be8-4f2c-87d9-e51674481b0a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:16.301106 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:16.302760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:16.303065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:16.303352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:16.314972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:16.317133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:16.322258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:16.324516 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:16.326225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:16.339445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 936/1858] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:16.339643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 922/1858] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:16.878984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:17.084279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:17.085969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:17.089649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:17.092212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:17.121205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa135ea-9a9d-43d7-b6f2-d8f5c22e2be8 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:17.125712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ba7ec-8a3a-4ef3-bc77-4b76b81f1b77 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:17.127207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:17.129124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:17.129510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:17.130006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] PATH_INFO: `/v3/projects/8d4def37e9cf4566a4a63d32013fc40f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:17.131461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4def37e9cf4566a4a63d32013fc40f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:17.133990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:17.137385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:17.138279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:17.138554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:17.138831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] PATH_INFO: `/v3/projects/1511c5871a894e48a326d13267fb538c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:17.142530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1511c5871a894e48a326d13267fb538c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:17.142995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:17.295727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4def37e9cf4566a4a63d32013fc40f', 'request_id': 'req-df449142-7204-40b3-820e-a7780553de13'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.304440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1511c5871a894e48a326d13267fb538c', 'request_id': 'req-d4664118-3356-41e6-96d1-033373b38c29'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.366849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4def37e9cf4566a4a63d32013fc40f', 'request_id': 'req-df449142-7204-40b3-820e-a7780553de13'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.373907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4def37e9cf4566a4a63d32013fc40f', 'request_id': 'req-df449142-7204-40b3-820e-a7780553de13'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.385594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] The token cache is being invalidate because project 8d4def37e9cf4566a4a63d32013fc40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:17.385882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.386537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.388172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 923/1859] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:17 2022] DELETE /identity/v3/projects/8d4def37e9cf4566a4a63d32013fc40f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:17.391959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:17.393346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:17.473385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df449142-7204-40b3-820e-a7780553de13 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:17.478442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:17.479403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:17.479683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:17.479958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] PATH_INFO: `/v3/users/9f24cad9aba84f0f8fee19f1ade6c9f6` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:17.481360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f24cad9aba84f0f8fee19f1ade6c9f6)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:17.483522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:17.489944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1511c5871a894e48a326d13267fb538c', 'request_id': 'req-d4664118-3356-41e6-96d1-033373b38c29'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.500549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1511c5871a894e48a326d13267fb538c', 'request_id': 'req-d4664118-3356-41e6-96d1-033373b38c29'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.513558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] The token cache is being invalidate because project 1511c5871a894e48a326d13267fb538c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:17.513894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.514769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.519096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 937/1860] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:17 2022] DELETE /identity/v3/projects/1511c5871a894e48a326d13267fb538c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:17.520093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:17.521499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:17.609781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4664118-3356-41e6-96d1-033373b38c29 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:17.615154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:17.616766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:17.617102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:17.617524 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] PATH_INFO: `/v3/users/d0d1f4ff45614d49b9b5486bd81541b5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:17.618829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d1f4ff45614d49b9b5486bd81541b5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:17.621012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:17.670165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f24cad9aba84f0f8fee19f1ade6c9f6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.671688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f24cad9aba84f0f8fee19f1ade6c9f6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.672694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f24cad9aba84f0f8fee19f1ade6c9f6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.688685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f24cad9aba84f0f8fee19f1ade6c9f6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.698147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f24cad9aba84f0f8fee19f1ade6c9f6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.781699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 924/1861] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:17 2022] DELETE /identity/v3/users/9f24cad9aba84f0f8fee19f1ade6c9f6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:17.870882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d1f4ff45614d49b9b5486bd81541b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.871652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d1f4ff45614d49b9b5486bd81541b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.872206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d1f4ff45614d49b9b5486bd81541b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.890481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d1f4ff45614d49b9b5486bd81541b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:17.900728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d1f4ff45614d49b9b5486bd81541b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:18.027059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 938/1862] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:17 2022] DELETE /identity/v3/users/d0d1f4ff45614d49b9b5486bd81541b5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:18.028539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:18.478819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:18.484836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:18.672172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff5af5-c5d3-4349-80f7-cf94239c6680 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:18.687309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:18.687309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:18.790940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:18.791919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:18.792323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:18.792700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] PATH_INFO: `/v3/projects/fccb7362857e4bddb03e9cb7b4b5cde8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:18.794337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fccb7362857e4bddb03e9cb7b4b5cde8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:18.798838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:18.924498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb94fb-792e-477f-b95e-264f358009aa admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:18.940022 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:18.942305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:18.942637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:18.945752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] PATH_INFO: `/v3/users/febac9846b4b4697b727c3458a96c5b8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:18.947885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=febac9846b4b4697b727c3458a96c5b8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:18.950343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:19.030170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fccb7362857e4bddb03e9cb7b4b5cde8', 'request_id': 'req-b29a20e3-3332-4a1f-8084-d80ee4359155'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.093936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:19.109632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fccb7362857e4bddb03e9cb7b4b5cde8', 'request_id': 'req-b29a20e3-3332-4a1f-8084-d80ee4359155'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.119248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fccb7362857e4bddb03e9cb7b4b5cde8', 'request_id': 'req-b29a20e3-3332-4a1f-8084-d80ee4359155'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.137768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] The token cache is being invalidate because project fccb7362857e4bddb03e9cb7b4b5cde8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:19.138243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.139096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.143455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 925/1863] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:18 2022] DELETE /identity/v3/projects/fccb7362857e4bddb03e9cb7b4b5cde8 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:19.147901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:19.147901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:19.218896 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febac9846b4b4697b727c3458a96c5b8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.220104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febac9846b4b4697b727c3458a96c5b8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.221783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febac9846b4b4697b727c3458a96c5b8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.237307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febac9846b4b4697b727c3458a96c5b8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.247311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febac9846b4b4697b727c3458a96c5b8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.277413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a20e3-3332-4a1f-8084-d80ee4359155 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:19.283963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:19.285429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:19.285429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:19.285914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] PATH_INFO: `/v3/projects/0c58d2caa472428bb4b4fb5fe1cc7ea3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:19.287158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c58d2caa472428bb4b4fb5fe1cc7ea3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:19.289581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:19.345482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 939/1864] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:18 2022] DELETE /identity/v3/users/febac9846b4b4697b727c3458a96c5b8 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:19.349170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:19.350588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:19.361837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:19.443202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c58d2caa472428bb4b4fb5fe1cc7ea3', 'request_id': 'req-acbfbf09-f7d0-4de8-980d-6e8e858444bd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.457645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95215fb-2259-466d-a049-805fa373a80b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:19.519244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c58d2caa472428bb4b4fb5fe1cc7ea3', 'request_id': 'req-acbfbf09-f7d0-4de8-980d-6e8e858444bd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.528096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:19.529159 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:19.529534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:19.529876 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] PATH_INFO: `/v3/users/03797829e5ee4c57bbf69bbfe0268002` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:19.530385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c58d2caa472428bb4b4fb5fe1cc7ea3', 'request_id': 'req-acbfbf09-f7d0-4de8-980d-6e8e858444bd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.531816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03797829e5ee4c57bbf69bbfe0268002)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:19.534362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:19.542829 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] The token cache is being invalidate because project 0c58d2caa472428bb4b4fb5fe1cc7ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:19.543116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.543901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acbfbf09-f7d0-4de8-980d-6e8e858444bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.546168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 926/1865] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:19 2022] DELETE /identity/v3/projects/0c58d2caa472428bb4b4fb5fe1cc7ea3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:19.547782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75519d-47bf-446d-b0ad-c7d4d8a8ff9f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:19.547985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75519d-47bf-446d-b0ad-c7d4d8a8ff9f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:19.548264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75519d-47bf-446d-b0ad-c7d4d8a8ff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:19.568193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6e75519d-47bf-446d-b0ad-c7d4d8a8ff9f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:19.570284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6e75519d-47bf-446d-b0ad-c7d4d8a8ff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:19.579136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 927/1866] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:19.580552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c2a7-8cc8-4d5f-bfc8-050831b6b233 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:19.580692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c2a7-8cc8-4d5f-bfc8-050831b6b233 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:19.580958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c2a7-8cc8-4d5f-bfc8-050831b6b233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:19.600460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5143c2a7-8cc8-4d5f-bfc8-050831b6b233 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:19.601604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5143c2a7-8cc8-4d5f-bfc8-050831b6b233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:19.609425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 928/1867] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:19.610222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143c2a7-8cc8-4d5f-bfc8-050831b6b233 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:19.617423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5143c2a7-8cc8-4d5f-bfc8-050831b6b233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:19.682764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143c2a7-8cc8-4d5f-bfc8-050831b6b233 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:19.686603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d222-d343-4c85-8809-4c15b4b6a19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:19.687534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d222-d343-4c85-8809-4c15b4b6a19d service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:19.687981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d222-d343-4c85-8809-4c15b4b6a19d service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:19.688196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d222-d343-4c85-8809-4c15b4b6a19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:19.699370 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d222-d343-4c85-8809-4c15b4b6a19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:19.700921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d222-d343-4c85-8809-4c15b4b6a19d service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:19.710828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 929/1868] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:19.712259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de1fd-bdf5-4897-a9f1-842e2028d2a2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:19.712534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de1fd-bdf5-4897-a9f1-842e2028d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:19.712815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de1fd-bdf5-4897-a9f1-842e2028d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:19.732024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ab2de1fd-bdf5-4897-a9f1-842e2028d2a2 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:19.733285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ab2de1fd-bdf5-4897-a9f1-842e2028d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:19.742629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 930/1869] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:19.746918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2de1fd-bdf5-4897-a9f1-842e2028d2a2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:19.756756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2de1fd-bdf5-4897-a9f1-842e2028d2a2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:19.762647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:19.763308 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:19.763869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:19.764654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:19.765461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03797829e5ee4c57bbf69bbfe0268002'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.765953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:19.766313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:19.767693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03797829e5ee4c57bbf69bbfe0268002'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.768625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03797829e5ee4c57bbf69bbfe0268002'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.768892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:19.782236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 931/1870] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:13:19.783363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03797829e5ee4c57bbf69bbfe0268002'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.786951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:19.789189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:19.794008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03797829e5ee4c57bbf69bbfe0268002'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:19.804454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e975d-43ed-40e1-8834-5f35c05e0ecc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:19.809578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf88fd9-de5c-4441-b4d7-9291d83422c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:19.814049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf88fd9-de5c-4441-b4d7-9291d83422c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:19.814049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf88fd9-de5c-4441-b4d7-9291d83422c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:19.814049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf88fd9-de5c-4441-b4d7-9291d83422c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:19.814049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf88fd9-de5c-4441-b4d7-9291d83422c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:19.814049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf88fd9-de5c-4441-b4d7-9291d83422c6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:19.897929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 940/1871] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:19 2022] DELETE /identity/v3/users/03797829e5ee4c57bbf69bbfe0268002 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:19.902044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 932/1872] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:19 2022] POST /identity/v3/projects => generated 388 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:19.906242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:19.978865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb8a8-51bf-4ef7-8da7-aaa2418f2691 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.057710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898012e-18d8-4de5-b941-18184883b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.058391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898012e-18d8-4de5-b941-18184883b965 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.058839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898012e-18d8-4de5-b941-18184883b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.059116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898012e-18d8-4de5-b941-18184883b965 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.059959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898012e-18d8-4de5-b941-18184883b965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:20.061830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898012e-18d8-4de5-b941-18184883b965 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:20.147247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 941/1873] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:19 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:20.148849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf88fd9-de5c-4441-b4d7-9291d83422c6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:20.159665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf88fd9-de5c-4441-b4d7-9291d83422c6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.165137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aff51-068d-4486-9cc0-14497c1cdf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.165934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aff51-068d-4486-9cc0-14497c1cdf81 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.166435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aff51-068d-4486-9cc0-14497c1cdf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.166684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aff51-068d-4486-9cc0-14497c1cdf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.167538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aff51-068d-4486-9cc0-14497c1cdf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:20.169327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aff51-068d-4486-9cc0-14497c1cdf81 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:20.180503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 933/1874] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:20 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:20.184911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898012e-18d8-4de5-b941-18184883b965 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:20.202546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898012e-18d8-4de5-b941-18184883b965 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.211671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.212647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.212982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.213267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.214050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:20.216048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:20.248657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 942/1875] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:20 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:20.249373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aff51-068d-4486-9cc0-14497c1cdf81 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:20.262743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aff51-068d-4486-9cc0-14497c1cdf81 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.265359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:20.267079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:20.269787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09d9f8-5959-4a2f-b365-2cd5a6672f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.270859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09d9f8-5959-4a2f-b365-2cd5a6672f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.271238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09d9f8-5959-4a2f-b365-2cd5a6672f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.271608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09d9f8-5959-4a2f-b365-2cd5a6672f76 admin admin] PATH_INFO: `/v3/projects/a8a7e573ede5423688d4463b2700d90c/users/5304f06f94124e6bb693dec2fe7b7917/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.298083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f72f05-6cca-43e1-ba8f-a2a4705b198e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.308994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.310176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.310743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.312424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] PATH_INFO: `/v3/projects/09f2daee4b5247e194d262b5f1dc891d` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.314306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f2daee4b5247e194d262b5f1dc891d)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:20.316437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:20.373616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09d9f8-5959-4a2f-b365-2cd5a6672f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a7e573ede5423688d4463b2700d90c, user_id=5304f06f94124e6bb693dec2fe7b7917, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:20.376648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09d9f8-5959-4a2f-b365-2cd5a6672f76 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:20.447761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 934/1876] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:20 2022] PUT /identity/v3/projects/a8a7e573ede5423688d4463b2700d90c/users/5304f06f94124e6bb693dec2fe7b7917/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:20.457445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f2daee4b5247e194d262b5f1dc891d', 'request_id': 'req-21201c64-3920-4a97-844a-ebcd4abcf49d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:20.462855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a51a-6764-44d8-b031-c759a1292d9c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.463469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a51a-6764-44d8-b031-c759a1292d9c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.464122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a51a-6764-44d8-b031-c759a1292d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.506268 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4dd8a51a-6764-44d8-b031-c759a1292d9c None None] MFA Rules not processed for user `5304f06f94124e6bb693dec2fe7b7917`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:20.510373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4dd8a51a-6764-44d8-b031-c759a1292d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:20.549884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f2daee4b5247e194d262b5f1dc891d', 'request_id': 'req-21201c64-3920-4a97-844a-ebcd4abcf49d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:20.561768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f2daee4b5247e194d262b5f1dc891d', 'request_id': 'req-21201c64-3920-4a97-844a-ebcd4abcf49d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:20.584346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] The token cache is being invalidate because project 09f2daee4b5247e194d262b5f1dc891d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:20.584973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:20.587105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:20.589040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 943/1877] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:20 2022] DELETE /identity/v3/projects/09f2daee4b5247e194d262b5f1dc891d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:20.589910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:20.591740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:20.637333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 935/1878] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:20.637333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8a51a-6764-44d8-b031-c759a1292d9c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:20.637333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4dd8a51a-6764-44d8-b031-c759a1292d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:20.707361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201c64-3920-4a97-844a-ebcd4abcf49d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.721158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.722125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.722481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.722828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] PATH_INFO: `/v3/projects/1fa74428c834492783652ecf71744a9b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.724287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa74428c834492783652ecf71744a9b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:20.728617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:20.745126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8a51a-6764-44d8-b031-c759a1292d9c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.750435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.751397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.751876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.752488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] PATH_INFO: `/v3/users/a6dcf089b94a402a9b095abcc177c382` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.758788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6dcf089b94a402a9b095abcc177c382)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:20.761961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:20.766808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:21.053110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa74428c834492783652ecf71744a9b', 'request_id': 'req-4d7a5e3e-65a8-41a3-a54e-58694209c665'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.055196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6dcf089b94a402a9b095abcc177c382'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.056555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6dcf089b94a402a9b095abcc177c382'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.058049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6dcf089b94a402a9b095abcc177c382'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.071835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6dcf089b94a402a9b095abcc177c382'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.080015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2aa730a3-8c65-49d1-a1d8-1dddc8051386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6dcf089b94a402a9b095abcc177c382'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.172445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa74428c834492783652ecf71744a9b', 'request_id': 'req-4d7a5e3e-65a8-41a3-a54e-58694209c665'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.179256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa74428c834492783652ecf71744a9b', 'request_id': 'req-4d7a5e3e-65a8-41a3-a54e-58694209c665'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.190197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] The token cache is being invalidate because project 1fa74428c834492783652ecf71744a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:21.190536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.191307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:21.197713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 944/1879] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:20 2022] DELETE /identity/v3/projects/1fa74428c834492783652ecf71744a9b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:21.197713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.198946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:21.315953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a5e3e-65a8-41a3-a54e-58694209c665 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:21.321545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 936/1880] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:20 2022] DELETE /identity/v3/users/a6dcf089b94a402a9b095abcc177c382 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:21.321545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e6a4-04fa-4968-ac47-45628211ed09 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.321545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e6a4-04fa-4968-ac47-45628211ed09 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.321545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e6a4-04fa-4968-ac47-45628211ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.351289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:21.357332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b102e6a4-04fa-4968-ac47-45628211ed09 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:21.358574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b102e6a4-04fa-4968-ac47-45628211ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:21.408386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc18825-371d-4b22-b8ac-f502809ffecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:21.409291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc18825-371d-4b22-b8ac-f502809ffecc admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.409572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc18825-371d-4b22-b8ac-f502809ffecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.409847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc18825-371d-4b22-b8ac-f502809ffecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.410532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc18825-371d-4b22-b8ac-f502809ffecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:21.412494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc18825-371d-4b22-b8ac-f502809ffecc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:21.452190 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 937/1881] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:21.462273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98346-6f2a-4af1-b4c2-f518f50c33b8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.462571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98346-6f2a-4af1-b4c2-f518f50c33b8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.462827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98346-6f2a-4af1-b4c2-f518f50c33b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.488168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-77c98346-6f2a-4af1-b4c2-f518f50c33b8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:21.489513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-77c98346-6f2a-4af1-b4c2-f518f50c33b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:21.498598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 938/1882] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:21.502576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98346-6f2a-4af1-b4c2-f518f50c33b8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.514137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98346-6f2a-4af1-b4c2-f518f50c33b8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:21.524022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:21.524737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.525021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.525294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.526033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:21.526342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:21.527999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:21.538946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 945/1883] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:21 2022] POST /identity/v3/projects => generated 386 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:21.543412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 939/1884] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:21.543610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc18825-371d-4b22-b8ac-f502809ffecc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.547730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.558293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a38918-b2e4-4c4b-b10e-114af3232228 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:21.613184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc18825-371d-4b22-b8ac-f502809ffecc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:21.622802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec961258-2746-49dc-939d-9460d1917889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:21.623494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec961258-2746-49dc-939d-9460d1917889 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.623789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec961258-2746-49dc-939d-9460d1917889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.624126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec961258-2746-49dc-939d-9460d1917889 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.624773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec961258-2746-49dc-939d-9460d1917889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:21.626716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec961258-2746-49dc-939d-9460d1917889 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:21.632725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023faaa-9877-4743-be06-093ce9efa009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:21.633413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023faaa-9877-4743-be06-093ce9efa009 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.633697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023faaa-9877-4743-be06-093ce9efa009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.633975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023faaa-9877-4743-be06-093ce9efa009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.634682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023faaa-9877-4743-be06-093ce9efa009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:21.636653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023faaa-9877-4743-be06-093ce9efa009 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:21.742352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 946/1885] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:21 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:21.743350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec961258-2746-49dc-939d-9460d1917889 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.754238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec961258-2746-49dc-939d-9460d1917889 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:21.759829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b5bf-2e8a-400e-8868-f19f0505be40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:21.760531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b5bf-2e8a-400e-8868-f19f0505be40 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.760817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b5bf-2e8a-400e-8868-f19f0505be40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.761094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b5bf-2e8a-400e-8868-f19f0505be40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.761827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b5bf-2e8a-400e-8868-f19f0505be40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:21.763751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b5bf-2e8a-400e-8868-f19f0505be40 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:21.771946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 940/1886] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:21 2022] POST /identity/v3/projects => generated 402 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:21.776908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023faaa-9877-4743-be06-093ce9efa009 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.781995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 947/1887] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:21 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:21.783692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b5bf-2e8a-400e-8868-f19f0505be40 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.794982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b5bf-2e8a-400e-8868-f19f0505be40 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:21.854288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023faaa-9877-4743-be06-093ce9efa009 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:21.860628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eef88-42ca-4d3b-bc29-7245dce8a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:21.861297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eef88-42ca-4d3b-bc29-7245dce8a271 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.861546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eef88-42ca-4d3b-bc29-7245dce8a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.861820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eef88-42ca-4d3b-bc29-7245dce8a271 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.862710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eef88-42ca-4d3b-bc29-7245dce8a271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:21.863294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf67aee-7a4e-4056-94eb-60bb6df7e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:21.864320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67aee-7a4e-4056-94eb-60bb6df7e4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:21.864717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eef88-42ca-4d3b-bc29-7245dce8a271 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:21.864811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67aee-7a4e-4056-94eb-60bb6df7e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:21.865327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67aee-7a4e-4056-94eb-60bb6df7e4a1 admin admin] PATH_INFO: `/v3/projects/071f420818f94af0b23c808555f2705e/users/6b0563ae8cdd493a8180a5bfcd74d1de/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.885995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf67aee-7a4e-4056-94eb-60bb6df7e4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071f420818f94af0b23c808555f2705e, user_id=6b0563ae8cdd493a8180a5bfcd74d1de, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:21.889302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf67aee-7a4e-4056-94eb-60bb6df7e4a1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:21.967903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 941/1888] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:21 2022] POST /identity/v3/users => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:21.972047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eef88-42ca-4d3b-bc29-7245dce8a271 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.972558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 948/1889] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:21 2022] PUT /identity/v3/projects/071f420818f94af0b23c808555f2705e/users/6b0563ae8cdd493a8180a5bfcd74d1de/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:21.977004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf67aee-7a4e-4056-94eb-60bb6df7e4a1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:21.993696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eef88-42ca-4d3b-bc29-7245dce8a271 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.055792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf67aee-7a4e-4056-94eb-60bb6df7e4a1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.061851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03684d7-a61e-491f-bf87-139602367881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.062249 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03684d7-a61e-491f-bf87-139602367881 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.062675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03684d7-a61e-491f-bf87-139602367881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.063105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03684d7-a61e-491f-bf87-139602367881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.063924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03684d7-a61e-491f-bf87-139602367881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.066186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03684d7-a61e-491f-bf87-139602367881 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.077826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4712-3fc3-4c2e-a054-161442709a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.079161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4712-3fc3-4c2e-a054-161442709a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.079819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4712-3fc3-4c2e-a054-161442709a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.080238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4712-3fc3-4c2e-a054-161442709a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.086518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4712-3fc3-4c2e-a054-161442709a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.086518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4712-3fc3-4c2e-a054-161442709a99 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.097143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 942/1890] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:21 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:22.098775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4712-3fc3-4c2e-a054-161442709a99 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:22.099658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 949/1891] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:21 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:22.101990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03684d7-a61e-491f-bf87-139602367881 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:22.112397 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03684d7-a61e-491f-bf87-139602367881 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.112940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4712-3fc3-4c2e-a054-161442709a99 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.118903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204863b9-0e65-4486-9e35-d8d1596d0c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.120229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204863b9-0e65-4486-9e35-d8d1596d0c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.121335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204863b9-0e65-4486-9e35-d8d1596d0c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.121460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fc719-3f14-46ba-923f-0f9b34665327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.121565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204863b9-0e65-4486-9e35-d8d1596d0c9d admin admin] PATH_INFO: `/v3/projects/071f420818f94af0b23c808555f2705e/users/6b0563ae8cdd493a8180a5bfcd74d1de/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.122088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc719-3f14-46ba-923f-0f9b34665327 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.122574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc719-3f14-46ba-923f-0f9b34665327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.122941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc719-3f14-46ba-923f-0f9b34665327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.123769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fc719-3f14-46ba-923f-0f9b34665327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.124540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204863b9-0e65-4486-9e35-d8d1596d0c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=071f420818f94af0b23c808555f2705e, user_id=6b0563ae8cdd493a8180a5bfcd74d1de, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.125879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fc719-3f14-46ba-923f-0f9b34665327 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.139239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 950/1892] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:22 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:22.141213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204863b9-0e65-4486-9e35-d8d1596d0c9d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.144759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fc719-3f14-46ba-923f-0f9b34665327 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:22.155918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 943/1893] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:22 2022] PUT /identity/v3/projects/071f420818f94af0b23c808555f2705e/users/6b0563ae8cdd493a8180a5bfcd74d1de/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:22.157228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fc719-3f14-46ba-923f-0f9b34665327 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.167243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d785-5482-4fd4-ab3e-23456d6bfcc5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.167663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d785-5482-4fd4-ab3e-23456d6bfcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.168042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810d785-5482-4fd4-ab3e-23456d6bfcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.201028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a810d785-5482-4fd4-ab3e-23456d6bfcc5 None None] MFA Rules not processed for user `6b0563ae8cdd493a8180a5bfcd74d1de`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:22.202447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a810d785-5482-4fd4-ab3e-23456d6bfcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:22.245875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a88f8-f480-462f-8035-37d034288d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.247493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a88f8-f480-462f-8035-37d034288d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.247786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a88f8-f480-462f-8035-37d034288d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.248106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a88f8-f480-462f-8035-37d034288d87 admin admin] PATH_INFO: `/v3/projects/d2273a04a6ec4af5b95672996c50163c/users/9b83899feb224d709b9c6124e091298f/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.288679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a88f8-f480-462f-8035-37d034288d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2273a04a6ec4af5b95672996c50163c, user_id=9b83899feb224d709b9c6124e091298f, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.291510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a88f8-f480-462f-8035-37d034288d87 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.309663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 944/1894] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:22.322389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810d785-5482-4fd4-ab3e-23456d6bfcc5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:22.324198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a810d785-5482-4fd4-ab3e-23456d6bfcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:22.367989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 951/1895] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:22 2022] PUT /identity/v3/projects/d2273a04a6ec4af5b95672996c50163c/users/9b83899feb224d709b9c6124e091298f/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:22.378970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bb5f8-3453-488a-9756-c00c50540986 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.379440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bb5f8-3453-488a-9756-c00c50540986 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.380509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bb5f8-3453-488a-9756-c00c50540986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.401895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810d785-5482-4fd4-ab3e-23456d6bfcc5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.414997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-906bb5f8-3453-488a-9756-c00c50540986 None None] MFA Rules not processed for user `9b83899feb224d709b9c6124e091298f`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:22.416529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-906bb5f8-3453-488a-9756-c00c50540986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:22.459497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c94554-8931-4f5f-b25f-740dfc266b51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.460882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c94554-8931-4f5f-b25f-740dfc266b51 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.461274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c94554-8931-4f5f-b25f-740dfc266b51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.462072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c94554-8931-4f5f-b25f-740dfc266b51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.501631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 952/1896] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:22.502615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bb5f8-3453-488a-9756-c00c50540986 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:22.504027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-906bb5f8-3453-488a-9756-c00c50540986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:22.545542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c94554-8931-4f5f-b25f-740dfc266b51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.547009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c94554-8931-4f5f-b25f-740dfc266b51 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.559182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 945/1897] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:22.560161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c94554-8931-4f5f-b25f-740dfc266b51 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:22.629708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bb5f8-3453-488a-9756-c00c50540986 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.639390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.640693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.641121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.643097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] PATH_INFO: `/v3/projects/32bab435d35c42d0922a3b5700dd1206` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.647905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bab435d35c42d0922a3b5700dd1206)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.653909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.662212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c94554-8931-4f5f-b25f-740dfc266b51 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.675192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6cace-fb8d-40af-9568-a357f2c521fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.675873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6cace-fb8d-40af-9568-a357f2c521fa admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.676160 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6cace-fb8d-40af-9568-a357f2c521fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.676471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6cace-fb8d-40af-9568-a357f2c521fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.677171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6cace-fb8d-40af-9568-a357f2c521fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.679493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6cace-fb8d-40af-9568-a357f2c521fa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.812930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bab435d35c42d0922a3b5700dd1206', 'request_id': 'req-03c788b4-0e09-45d7-a7c9-1e8e415930ec'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:22.835654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 946/1898] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:22 2022] POST /identity/v3/projects => generated 402 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:22.841339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6cace-fb8d-40af-9568-a357f2c521fa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:22.887566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bab435d35c42d0922a3b5700dd1206', 'request_id': 'req-03c788b4-0e09-45d7-a7c9-1e8e415930ec'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:22.899122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bab435d35c42d0922a3b5700dd1206', 'request_id': 'req-03c788b4-0e09-45d7-a7c9-1e8e415930ec'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:22.918796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6cace-fb8d-40af-9568-a357f2c521fa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:22.925064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:22.925889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.926287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.926765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.927810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:22.930047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:22.931043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] The token cache is being invalidate because project 32bab435d35c42d0922a3b5700dd1206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:22.931485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:22.937523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-03c788b4-0e09-45d7-a7c9-1e8e415930ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:22.937967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 953/1899] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:22 2022] DELETE /identity/v3/projects/32bab435d35c42d0922a3b5700dd1206 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:22.940412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6017-5e21-411c-927a-1fa297acba6c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.944801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6017-5e21-411c-927a-1fa297acba6c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.945266 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6017-5e21-411c-927a-1fa297acba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:22.968191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-91dc6017-5e21-411c-927a-1fa297acba6c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:22.969431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-91dc6017-5e21-411c-927a-1fa297acba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:22.978500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 954/1900] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:22.986591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd3b0c-3904-4431-b573-986977fa2c76 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:22.986904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd3b0c-3904-4431-b573-986977fa2c76 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:22.987184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd3b0c-3904-4431-b573-986977fa2c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.005642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-03dd3b0c-3904-4431-b573-986977fa2c76 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:23.007392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-03dd3b0c-3904-4431-b573-986977fa2c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.015947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 955/1901] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:23.020090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd3b0c-3904-4431-b573-986977fa2c76 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.030710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd3b0c-3904-4431-b573-986977fa2c76 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.035826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.036519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.036807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.037084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.037848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:23.038240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.040278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.048071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 947/1902] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:22 2022] POST /identity/v3/users => generated 308 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:23.052124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.056879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.057020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 956/1903] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:13:23.058353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.071958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cace8-c375-40d4-8ff4-c651702f7540 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.073096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f80f6-ca40-4bc7-8044-4831b1576645 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.077330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21f03b-5f34-43c5-8c03-a55f1ef3f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.078006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f03b-5f34-43c5-8c03-a55f1ef3f481 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.078220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568e662-fea1-493f-9cf3-0cfa36bf7560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.078333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f03b-5f34-43c5-8c03-a55f1ef3f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.078552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f03b-5f34-43c5-8c03-a55f1ef3f481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.078917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e662-fea1-493f-9cf3-0cfa36bf7560 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.079196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e662-fea1-493f-9cf3-0cfa36bf7560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.079488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21f03b-5f34-43c5-8c03-a55f1ef3f481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.079583 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e662-fea1-493f-9cf3-0cfa36bf7560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.080171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568e662-fea1-493f-9cf3-0cfa36bf7560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.081994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21f03b-5f34-43c5-8c03-a55f1ef3f481 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.082109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568e662-fea1-493f-9cf3-0cfa36bf7560 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.095388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 948/1904] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:23.099450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21f03b-5f34-43c5-8c03-a55f1ef3f481 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.109697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21f03b-5f34-43c5-8c03-a55f1ef3f481 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.114372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b6503-8cfb-43e3-a8a4-3e7153d4492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.115386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b6503-8cfb-43e3-a8a4-3e7153d4492e admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.115666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b6503-8cfb-43e3-a8a4-3e7153d4492e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.115966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b6503-8cfb-43e3-a8a4-3e7153d4492e admin admin] PATH_INFO: `/v3/projects/9c95d1059b6249b7974226585e72b15c/users/e3c475e08a5b4492870684df38961f08/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.132418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b6503-8cfb-43e3-a8a4-3e7153d4492e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c95d1059b6249b7974226585e72b15c, user_id=e3c475e08a5b4492870684df38961f08, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.135235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b6503-8cfb-43e3-a8a4-3e7153d4492e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.206353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 957/1905] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:23 2022] POST /identity/v3/projects => generated 368 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:23.211554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568e662-fea1-493f-9cf3-0cfa36bf7560 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.234660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 949/1906] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:23 2022] PUT /identity/v3/projects/9c95d1059b6249b7974226585e72b15c/users/e3c475e08a5b4492870684df38961f08/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:23.238508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b6503-8cfb-43e3-a8a4-3e7153d4492e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.312498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:23.327795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568e662-fea1-493f-9cf3-0cfa36bf7560 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.333898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586468-aab7-4042-b09d-28b36ef6c725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.334681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586468-aab7-4042-b09d-28b36ef6c725 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.335656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586468-aab7-4042-b09d-28b36ef6c725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.335999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586468-aab7-4042-b09d-28b36ef6c725 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.339251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32586468-aab7-4042-b09d-28b36ef6c725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.342916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32586468-aab7-4042-b09d-28b36ef6c725 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.354256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b6503-8cfb-43e3-a8a4-3e7153d4492e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.360752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a672025-b327-4f52-8599-4c0193032ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.362950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a672025-b327-4f52-8599-4c0193032ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.362950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a672025-b327-4f52-8599-4c0193032ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.362950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a672025-b327-4f52-8599-4c0193032ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.362950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a672025-b327-4f52-8599-4c0193032ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.364325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a672025-b327-4f52-8599-4c0193032ec4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.384520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 950/1907] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/roles => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:23.384520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a672025-b327-4f52-8599-4c0193032ec4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.392778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a672025-b327-4f52-8599-4c0193032ec4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.397835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fb58f-b894-4274-8675-d15e99230218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.398719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb58f-b894-4274-8675-d15e99230218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.399132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb58f-b894-4274-8675-d15e99230218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.399435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb58f-b894-4274-8675-d15e99230218 admin admin] PATH_INFO: `/v3/projects/9c95d1059b6249b7974226585e72b15c/users/e3c475e08a5b4492870684df38961f08/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.401446 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fb58f-b894-4274-8675-d15e99230218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c95d1059b6249b7974226585e72b15c, user_id=e3c475e08a5b4492870684df38961f08, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.404115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fb58f-b894-4274-8675-d15e99230218 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.414934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 951/1908] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:23 2022] PUT /identity/v3/projects/9c95d1059b6249b7974226585e72b15c/users/e3c475e08a5b4492870684df38961f08/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:23.425295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8001-84dc-4a0e-a202-b00d720a77fb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.425583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8001-84dc-4a0e-a202-b00d720a77fb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.425851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee8001-84dc-4a0e-a202-b00d720a77fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.453242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 958/1909] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:23 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:23.453679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0dee8001-84dc-4a0e-a202-b00d720a77fb None None] MFA Rules not processed for user `e3c475e08a5b4492870684df38961f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:23.454885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0dee8001-84dc-4a0e-a202-b00d720a77fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.457971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586468-aab7-4042-b09d-28b36ef6c725 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.474153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586468-aab7-4042-b09d-28b36ef6c725 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.563429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 952/1910] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:23.570629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:23.575931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee8001-84dc-4a0e-a202-b00d720a77fb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.577515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0dee8001-84dc-4a0e-a202-b00d720a77fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.578125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139648f-9f1c-4444-94e7-d6e45c537321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.578776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139648f-9f1c-4444-94e7-d6e45c537321 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.579053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139648f-9f1c-4444-94e7-d6e45c537321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.579323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139648f-9f1c-4444-94e7-d6e45c537321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.580133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139648f-9f1c-4444-94e7-d6e45c537321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.581777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139648f-9f1c-4444-94e7-d6e45c537321 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.592961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 959/1911] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/roles => generated 1427 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:23.597138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139648f-9f1c-4444-94e7-d6e45c537321 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.608106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139648f-9f1c-4444-94e7-d6e45c537321 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.612683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d6de2-8769-47c5-b6da-1f121a434948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.613338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d6de2-8769-47c5-b6da-1f121a434948 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.613617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d6de2-8769-47c5-b6da-1f121a434948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.613887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d6de2-8769-47c5-b6da-1f121a434948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.614603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d6de2-8769-47c5-b6da-1f121a434948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.616225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d6de2-8769-47c5-b6da-1f121a434948 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.626467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 960/1912] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:23.630713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d6de2-8769-47c5-b6da-1f121a434948 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.645134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d6de2-8769-47c5-b6da-1f121a434948 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.651431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe75ad2-198f-4b47-88a3-78906506770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.652496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75ad2-198f-4b47-88a3-78906506770e admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.652788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75ad2-198f-4b47-88a3-78906506770e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.653064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75ad2-198f-4b47-88a3-78906506770e admin admin] PATH_INFO: `/v3/projects/60fc9959fd0b4f24a9041838db01e3bd/users/c49cfdd6c17a495c99007cc63e1e1566/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.658679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee8001-84dc-4a0e-a202-b00d720a77fb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.668525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890813-7235-413f-8add-0aad2205af58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.669665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890813-7235-413f-8add-0aad2205af58 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.670174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890813-7235-413f-8add-0aad2205af58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.670551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890813-7235-413f-8add-0aad2205af58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.674912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe75ad2-198f-4b47-88a3-78906506770e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fc9959fd0b4f24a9041838db01e3bd, user_id=c49cfdd6c17a495c99007cc63e1e1566, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.677814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe75ad2-198f-4b47-88a3-78906506770e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.685505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890813-7235-413f-8add-0aad2205af58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.686964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890813-7235-413f-8add-0aad2205af58 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.697668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 953/1913] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:23.773681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 961/1914] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:23 2022] PUT /identity/v3/projects/60fc9959fd0b4f24a9041838db01e3bd/users/c49cfdd6c17a495c99007cc63e1e1566/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:23.784508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612372ed-95b8-4e21-aad7-8ff27ea70672 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.784794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612372ed-95b8-4e21-aad7-8ff27ea70672 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.785069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612372ed-95b8-4e21-aad7-8ff27ea70672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.813479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-612372ed-95b8-4e21-aad7-8ff27ea70672 None None] MFA Rules not processed for user `c49cfdd6c17a495c99007cc63e1e1566`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:23.814716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-612372ed-95b8-4e21-aad7-8ff27ea70672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.886479 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 954/1915] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:23.891220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe75ad2-198f-4b47-88a3-78906506770e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.957917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe75ad2-198f-4b47-88a3-78906506770e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.968261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d4d2-118d-4b34-af18-97febbf3c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.968261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d4d2-118d-4b34-af18-97febbf3c598 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.968261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d4d2-118d-4b34-af18-97febbf3c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.968261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d4d2-118d-4b34-af18-97febbf3c598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.968761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612372ed-95b8-4e21-aad7-8ff27ea70672 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.968838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d4d2-118d-4b34-af18-97febbf3c598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.968918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-612372ed-95b8-4e21-aad7-8ff27ea70672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.968990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d4d2-118d-4b34-af18-97febbf3c598 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.026188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612372ed-95b8-4e21-aad7-8ff27ea70672 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:24.029808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:24.030444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.030721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.030989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.032898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:24.057834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 962/1916] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:23 2022] POST /identity/v3/projects => generated 368 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:24.061450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d4d2-118d-4b34-af18-97febbf3c598 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:24.094709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:24.096097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.105610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 955/1917] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:24.124613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d4d2-118d-4b34-af18-97febbf3c598 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:24.129903 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f79d0-3ea0-469e-8fb0-19f2b420a115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:24.130739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f79d0-3ea0-469e-8fb0-19f2b420a115 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.132888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f79d0-3ea0-469e-8fb0-19f2b420a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.133190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f79d0-3ea0-469e-8fb0-19f2b420a115 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.133967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f79d0-3ea0-469e-8fb0-19f2b420a115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:24.136271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f79d0-3ea0-469e-8fb0-19f2b420a115 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.228034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 963/1918] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:24 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:24.232374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:24.243532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76db1d-5742-4b5a-ba6e-1f82fdf0367b service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:24.248035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:24.248729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.249010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.249283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.250002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:24.251620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.262329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 956/1919] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:24 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:24.266629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f79d0-3ea0-469e-8fb0-19f2b420a115 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:24.276715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f79d0-3ea0-469e-8fb0-19f2b420a115 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:24.281389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c9bb-d149-4d58-8c01-31e64bd8200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:24.282273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c9bb-d149-4d58-8c01-31e64bd8200a admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.282697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c9bb-d149-4d58-8c01-31e64bd8200a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.282841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c9bb-d149-4d58-8c01-31e64bd8200a admin admin] PATH_INFO: `/v3/projects/7521d79e71c84849a727091f4caf94eb/users/68a963275b4d4394ae72471d83259b35/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.300853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2c9bb-d149-4d58-8c01-31e64bd8200a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7521d79e71c84849a727091f4caf94eb, user_id=68a963275b4d4394ae72471d83259b35, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:24.304504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2c9bb-d149-4d58-8c01-31e64bd8200a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.414012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 964/1920] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:24 2022] PUT /identity/v3/projects/7521d79e71c84849a727091f4caf94eb/users/68a963275b4d4394ae72471d83259b35/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:24.418748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:24.421904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:24.425227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c9bb-d149-4d58-8c01-31e64bd8200a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:24.452264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e9c2-1828-4b56-b616-4117726dfcb8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:24.557712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:24.558818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.559310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.559800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] PATH_INFO: `/v3/users/5304f06f94124e6bb693dec2fe7b7917` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.561517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5304f06f94124e6bb693dec2fe7b7917)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:24.563820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.568375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c9bb-d149-4d58-8c01-31e64bd8200a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:24.581629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05e877-2297-477c-bffa-586246d97165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:24.582327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e877-2297-477c-bffa-586246d97165 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.582927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e877-2297-477c-bffa-586246d97165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.583215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e877-2297-477c-bffa-586246d97165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.585785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05e877-2297-477c-bffa-586246d97165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:24.588190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05e877-2297-477c-bffa-586246d97165 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.601907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 965/1921] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:24 2022] GET /identity/v3/roles => generated 1427 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:24.605887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05e877-2297-477c-bffa-586246d97165 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:24.615800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05e877-2297-477c-bffa-586246d97165 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:24.622110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35fa2e-b0b8-48d0-a8ce-2b72e8751fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:24.624803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fa2e-b0b8-48d0-a8ce-2b72e8751fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.624803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fa2e-b0b8-48d0-a8ce-2b72e8751fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.624803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fa2e-b0b8-48d0-a8ce-2b72e8751fc7 admin admin] PATH_INFO: `/v3/projects/7521d79e71c84849a727091f4caf94eb/users/68a963275b4d4394ae72471d83259b35/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.626685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35fa2e-b0b8-48d0-a8ce-2b72e8751fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7521d79e71c84849a727091f4caf94eb, user_id=68a963275b4d4394ae72471d83259b35, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:24.629040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35fa2e-b0b8-48d0-a8ce-2b72e8751fc7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.641123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 966/1922] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:24 2022] PUT /identity/v3/projects/7521d79e71c84849a727091f4caf94eb/users/68a963275b4d4394ae72471d83259b35/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:24.652422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d9b-8fb2-468f-b400-0eb38388a8af None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.654772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d9b-8fb2-468f-b400-0eb38388a8af None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.654772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94d9b-8fb2-468f-b400-0eb38388a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.681708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c6c94d9b-8fb2-468f-b400-0eb38388a8af None None] MFA Rules not processed for user `68a963275b4d4394ae72471d83259b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:24.682930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c6c94d9b-8fb2-468f-b400-0eb38388a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:24.751335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 967/1923] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:24.762600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94d9b-8fb2-468f-b400-0eb38388a8af None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:24.770004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5304f06f94124e6bb693dec2fe7b7917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:24.770731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5304f06f94124e6bb693dec2fe7b7917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:24.771430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5304f06f94124e6bb693dec2fe7b7917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:24.783741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5304f06f94124e6bb693dec2fe7b7917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:24.791011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5304f06f94124e6bb693dec2fe7b7917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:24.817724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94d9b-8fb2-468f-b400-0eb38388a8af None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:24.821892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119e1af-d5b8-491a-8a25-ab42dd0d125e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:24.822538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e1af-d5b8-491a-8a25-ab42dd0d125e service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.822816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e1af-d5b8-491a-8a25-ab42dd0d125e service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.823103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e1af-d5b8-491a-8a25-ab42dd0d125e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.824976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d119e1af-d5b8-491a-8a25-ab42dd0d125e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:24.837354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119e1af-d5b8-491a-8a25-ab42dd0d125e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:24.838760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119e1af-d5b8-491a-8a25-ab42dd0d125e service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:24.848143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 968/1924] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:24.875865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 957/1925] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:24 2022] DELETE /identity/v3/users/5304f06f94124e6bb693dec2fe7b7917 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:24.881234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea91d-f812-4cb6-97fe-9656295fb247 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:24.881632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea91d-f812-4cb6-97fe-9656295fb247 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:24.881846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea91d-f812-4cb6-97fe-9656295fb247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:24.900717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-372ea91d-f812-4cb6-97fe-9656295fb247 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:24.901913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-372ea91d-f812-4cb6-97fe-9656295fb247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:24.965614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 969/1926] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:24.982958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:24.984911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:25.053315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39493777-c03a-41e3-831e-b56eef6b3db8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:25.058561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:25.058561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:25.058561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:25.058561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:25.068668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:25.070493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:25.080027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 958/1927] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:25.119651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ea91d-f812-4cb6-97fe-9656295fb247 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:25.121147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-372ea91d-f812-4cb6-97fe-9656295fb247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:25.176464 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:25.186344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ea91d-f812-4cb6-97fe-9656295fb247 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:25.190282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:25.190955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:25.191239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:25.191518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:25.193589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:25.259665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:25.261160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:25.271460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 970/1928] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:25.521853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:25.716323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:25.718266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:25.764721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf691-0637-4bfb-8bf2-16b0f48f3282 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:25.778716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:25.779597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:25.780334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:25.783148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] PATH_INFO: `/v3/projects/a8a7e573ede5423688d4463b2700d90c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:25.788863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a7e573ede5423688d4463b2700d90c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:25.788863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:25.905138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a7e573ede5423688d4463b2700d90c', 'request_id': 'req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:25.990481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:25.991290 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a7e573ede5423688d4463b2700d90c', 'request_id': 'req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:25.999039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a7e573ede5423688d4463b2700d90c', 'request_id': 'req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:26.013055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] The token cache is being invalidate because project a8a7e573ede5423688d4463b2700d90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:26.013350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:26.016615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:26.016615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 959/1929] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:25 2022] DELETE /identity/v3/projects/a8a7e573ede5423688d4463b2700d90c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:26.019835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:26.031400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65163363-1bbc-462f-90e6-b833158ee49c service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:26.094919 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:26.095924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:26.096209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:26.096508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] PATH_INFO: `/v3/users/6b0563ae8cdd493a8180a5bfcd74d1de` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:26.097713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0563ae8cdd493a8180a5bfcd74d1de)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:26.099639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:26.583930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0563ae8cdd493a8180a5bfcd74d1de'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:26.583930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0563ae8cdd493a8180a5bfcd74d1de'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:26.584148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0563ae8cdd493a8180a5bfcd74d1de'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:26.596897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0563ae8cdd493a8180a5bfcd74d1de'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:26.604751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3b401e0e-1679-4ff2-a68c-68b6a619b543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0563ae8cdd493a8180a5bfcd74d1de'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:26.729856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:26.737080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 971/1930] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:26 2022] DELETE /identity/v3/users/6b0563ae8cdd493a8180a5bfcd74d1de => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:27.287399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:27.300633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:27.300633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:27.323349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4b72a-16eb-4873-8b75-20eb94c5f5d7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:27.380620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:27.381631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:27.382529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:27.383086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] PATH_INFO: `/v3/projects/071f420818f94af0b23c808555f2705e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:27.384105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071f420818f94af0b23c808555f2705e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:27.386094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:27.521195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071f420818f94af0b23c808555f2705e', 'request_id': 'req-29aef672-7506-439c-9a90-06879482a717'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:27.606766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071f420818f94af0b23c808555f2705e', 'request_id': 'req-29aef672-7506-439c-9a90-06879482a717'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:27.613717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071f420818f94af0b23c808555f2705e', 'request_id': 'req-29aef672-7506-439c-9a90-06879482a717'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:27.626077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] The token cache is being invalidate because project 071f420818f94af0b23c808555f2705e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:27.626368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:27.627021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-29aef672-7506-439c-9a90-06879482a717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:27.628707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 960/1931] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:27 2022] DELETE /identity/v3/projects/071f420818f94af0b23c808555f2705e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:27.638956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32d26-24ca-4891-8434-07a8f8411f95 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:27.639530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32d26-24ca-4891-8434-07a8f8411f95 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:27.639728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32d26-24ca-4891-8434-07a8f8411f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:27.659427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dba32d26-24ca-4891-8434-07a8f8411f95 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:27.661932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dba32d26-24ca-4891-8434-07a8f8411f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:27.730772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 972/1932] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:27.738647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113548-354b-46d3-91c9-16e50a3664ea None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:27.738964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113548-354b-46d3-91c9-16e50a3664ea None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:27.739442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113548-354b-46d3-91c9-16e50a3664ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:27.758634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f0113548-354b-46d3-91c9-16e50a3664ea None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:27.760067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f0113548-354b-46d3-91c9-16e50a3664ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:27.768863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 961/1933] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:27.773261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32d26-24ca-4891-8434-07a8f8411f95 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:27.782963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32d26-24ca-4891-8434-07a8f8411f95 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:27.787859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:27.789081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:27.789698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:27.789698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:27.790388 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:27.790695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:27.792293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:27.805148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 973/1934] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:27.809484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0113548-354b-46d3-91c9-16e50a3664ea None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:27.819320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0113548-354b-46d3-91c9-16e50a3664ea None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:27.826317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:27.826990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:27.827276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:27.827550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:27.828326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:27.830306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:27.939978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 962/1935] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:27 2022] POST /identity/v3/projects => generated 386 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:27.944617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:27.954681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8a2f-abcd-4551-9713-cbc39c169212 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:27.992615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:27.994488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:28.019426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6e9a0-02ca-4054-9497-805a14a42e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.020163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6e9a0-02ca-4054-9497-805a14a42e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.020477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6e9a0-02ca-4054-9497-805a14a42e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.020753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6e9a0-02ca-4054-9497-805a14a42e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.021479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6e9a0-02ca-4054-9497-805a14a42e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.023405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6e9a0-02ca-4054-9497-805a14a42e50 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:28.064760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519988b-3e57-4cce-b299-c0309b6365ac admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:28.070712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.071682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.071963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.072239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] PATH_INFO: `/v3/users/5a3cff65840a42d58952d7edbb56529f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.073494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3cff65840a42d58952d7edbb56529f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.077370 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:28.168045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 974/1936] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:27 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:28.172020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6e9a0-02ca-4054-9497-805a14a42e50 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:28.197783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6e9a0-02ca-4054-9497-805a14a42e50 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:28.219160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de8b9-8930-4583-95af-c42cc142e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.219856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de8b9-8930-4583-95af-c42cc142e5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.220540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de8b9-8930-4583-95af-c42cc142e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.220757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de8b9-8930-4583-95af-c42cc142e5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.221489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de8b9-8930-4583-95af-c42cc142e5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.223866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de8b9-8930-4583-95af-c42cc142e5bf admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:28.240797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 975/1937] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:28 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:28.243731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de8b9-8930-4583-95af-c42cc142e5bf admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:28.258683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de8b9-8930-4583-95af-c42cc142e5bf admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:28.263748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662675a4-f37a-4c6d-98a1-8932907a2912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.264292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662675a4-f37a-4c6d-98a1-8932907a2912 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.264595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662675a4-f37a-4c6d-98a1-8932907a2912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.264927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662675a4-f37a-4c6d-98a1-8932907a2912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.265667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662675a4-f37a-4c6d-98a1-8932907a2912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.267257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662675a4-f37a-4c6d-98a1-8932907a2912 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:28.282706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 976/1938] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:28 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:28.288817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662675a4-f37a-4c6d-98a1-8932907a2912 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:28.307241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662675a4-f37a-4c6d-98a1-8932907a2912 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:28.312766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0066649-8288-4308-8967-232800b796db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.313945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066649-8288-4308-8967-232800b796db admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.314303 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066649-8288-4308-8967-232800b796db admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.314494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066649-8288-4308-8967-232800b796db admin admin] PATH_INFO: `/v3/projects/8a46965307364ac892610f1b4f35cbe5/users/7114e259679744af952c7ffe99f13145/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.325217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3cff65840a42d58952d7edbb56529f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:28.326122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3cff65840a42d58952d7edbb56529f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:28.327161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3cff65840a42d58952d7edbb56529f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:28.332398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0066649-8288-4308-8967-232800b796db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a46965307364ac892610f1b4f35cbe5, user_id=7114e259679744af952c7ffe99f13145, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.340411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0066649-8288-4308-8967-232800b796db admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:28.340545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3cff65840a42d58952d7edbb56529f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:28.346855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5fc15f0-b4b8-4046-9fa9-7744c1a4732d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3cff65840a42d58952d7edbb56529f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:28.535887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 963/1939] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:27 2022] DELETE /identity/v3/users/5a3cff65840a42d58952d7edbb56529f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:28.548204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 977/1940] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:28 2022] PUT /identity/v3/projects/8a46965307364ac892610f1b4f35cbe5/users/7114e259679744af952c7ffe99f13145/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:28.552849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8c4b-edbc-4fb4-86b4-4600ba2a6129 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.552849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8c4b-edbc-4fb4-86b4-4600ba2a6129 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.552849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8c4b-edbc-4fb4-86b4-4600ba2a6129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.577791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-209b8c4b-edbc-4fb4-86b4-4600ba2a6129 None None] MFA Rules not processed for user `7114e259679744af952c7ffe99f13145`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:28.579010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-209b8c4b-edbc-4fb4-86b4-4600ba2a6129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:28.654653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 964/1941] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:28.667567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0066649-8288-4308-8967-232800b796db admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:28.669371 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b0066649-8288-4308-8967-232800b796db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:28.732674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0066649-8288-4308-8967-232800b796db admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:28.782797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.783704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.783986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.784259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.794649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.796949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:28.802894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8c4b-edbc-4fb4-86b4-4600ba2a6129 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:28.805007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-209b8c4b-edbc-4fb4-86b4-4600ba2a6129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:28.810696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 978/1942] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:28.834348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:28.837238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:28.888116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8c4b-edbc-4fb4-86b4-4600ba2a6129 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:28.898582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.899568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.899849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.900118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] PATH_INFO: `/v3/projects/f410bf6db858457db5a8d60731e2a744` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.901448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f410bf6db858457db5a8d60731e2a744)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.903515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:28.906352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76269d5-70d4-4e33-a380-72b6fbc96dee service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:28.911497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.912444 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.912794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.913701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] PATH_INFO: `/v3/users/7114e259679744af952c7ffe99f13145` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.915004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7114e259679744af952c7ffe99f13145)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.920961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:29.116829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7114e259679744af952c7ffe99f13145'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.117015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f410bf6db858457db5a8d60731e2a744', 'request_id': 'req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.118087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7114e259679744af952c7ffe99f13145'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.118713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7114e259679744af952c7ffe99f13145'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.130725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7114e259679744af952c7ffe99f13145'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.137756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d31c1365-ed71-4379-a328-9fc05d3c452d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7114e259679744af952c7ffe99f13145'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.187087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f410bf6db858457db5a8d60731e2a744', 'request_id': 'req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.194012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f410bf6db858457db5a8d60731e2a744', 'request_id': 'req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.204791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] The token cache is being invalidate because project f410bf6db858457db5a8d60731e2a744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:29.205078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.205713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d3f2da8f-b8d8-4a0e-99e4-8f2c1a994af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:29.207311 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 965/1943] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:28 2022] DELETE /identity/v3/projects/f410bf6db858457db5a8d60731e2a744 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:29.212060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2370db-49a8-4569-92fd-7db6919d13a7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.212598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2370db-49a8-4569-92fd-7db6919d13a7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.213083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2370db-49a8-4569-92fd-7db6919d13a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.234816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1d2370db-49a8-4569-92fd-7db6919d13a7 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:29.236167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1d2370db-49a8-4569-92fd-7db6919d13a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:29.305248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 979/1944] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:28 2022] DELETE /identity/v3/users/7114e259679744af952c7ffe99f13145 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:29.307817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae3eb-5766-45e7-95fc-9aa8bad896f1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.308204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae3eb-5766-45e7-95fc-9aa8bad896f1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.308611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae3eb-5766-45e7-95fc-9aa8bad896f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.317533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 966/1945] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:29.320679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633238bd-9a66-4ba2-ac8a-fc76e3308f8b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.320972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633238bd-9a66-4ba2-ac8a-fc76e3308f8b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.321246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633238bd-9a66-4ba2-ac8a-fc76e3308f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.343606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a54ae3eb-5766-45e7-95fc-9aa8bad896f1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:29.344916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a54ae3eb-5766-45e7-95fc-9aa8bad896f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:29.348800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-633238bd-9a66-4ba2-ac8a-fc76e3308f8b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:29.348800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-633238bd-9a66-4ba2-ac8a-fc76e3308f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:29.417819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 980/1946] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:29.426579 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 967/1947] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:29.431359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ae3eb-5766-45e7-95fc-9aa8bad896f1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:29.433280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633238bd-9a66-4ba2-ac8a-fc76e3308f8b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:29.434658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-633238bd-9a66-4ba2-ac8a-fc76e3308f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:29.441473 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ae3eb-5766-45e7-95fc-9aa8bad896f1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:29.447031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:29.452697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.452697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.452697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.452697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:29.452697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:29.452697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:29.465873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 981/1948] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:29.466950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:29.477128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fef85-143b-4ea6-afcb-9d94d9974db0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:29.481787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc522-3291-433a-a8ee-73ff8e0e907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:29.482429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc522-3291-433a-a8ee-73ff8e0e907f admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.482710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc522-3291-433a-a8ee-73ff8e0e907f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.482983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc522-3291-433a-a8ee-73ff8e0e907f admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.483655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cc522-3291-433a-a8ee-73ff8e0e907f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:29.485569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cc522-3291-433a-a8ee-73ff8e0e907f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:29.493241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633238bd-9a66-4ba2-ac8a-fc76e3308f8b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:29.497936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f948b-643e-4fab-b3ff-018c2618304f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:29.498592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f948b-643e-4fab-b3ff-018c2618304f service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.498877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f948b-643e-4fab-b3ff-018c2618304f service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.499153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f948b-643e-4fab-b3ff-018c2618304f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.509820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f948b-643e-4fab-b3ff-018c2618304f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:29.512512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f948b-643e-4fab-b3ff-018c2618304f service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:29.526854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 968/1949] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:29.621936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:29.700554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 982/1950] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:29 2022] POST /identity/v3/projects => generated 376 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:29.701663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f948b-643e-4fab-b3ff-018c2618304f service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:29.711783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f948b-643e-4fab-b3ff-018c2618304f service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:29.768972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502598f-58f5-4b57-bcae-9a5cd03785fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:29.769634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502598f-58f5-4b57-bcae-9a5cd03785fa admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.769913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502598f-58f5-4b57-bcae-9a5cd03785fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.770186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502598f-58f5-4b57-bcae-9a5cd03785fa admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.770869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502598f-58f5-4b57-bcae-9a5cd03785fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:29.772876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502598f-58f5-4b57-bcae-9a5cd03785fa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:29.870442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 969/1951] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:29 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:29.874459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc522-3291-433a-a8ee-73ff8e0e907f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:29.885720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc522-3291-433a-a8ee-73ff8e0e907f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:29.890523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bb2ad-1278-4c31-81db-56c15be94bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:29.891187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bb2ad-1278-4c31-81db-56c15be94bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.891465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bb2ad-1278-4c31-81db-56c15be94bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.891732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bb2ad-1278-4c31-81db-56c15be94bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.892486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bb2ad-1278-4c31-81db-56c15be94bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:29.894086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bb2ad-1278-4c31-81db-56c15be94bb5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:29.904733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 983/1952] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:29 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:29.909126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502598f-58f5-4b57-bcae-9a5cd03785fa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:29.923158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502598f-58f5-4b57-bcae-9a5cd03785fa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:29.930043 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:29.931557 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.931848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.932123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.932948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:29.939470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:29.949049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 970/1953] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:29 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:29.950447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bb2ad-1278-4c31-81db-56c15be94bb5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:29.961687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bb2ad-1278-4c31-81db-56c15be94bb5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:29.966399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:29.967393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:29.967733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:29.968066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] PATH_INFO: `/v3/projects/d261461e12e34816a03c05f278fd6251/users/8c1be8ccf2f14e55a5f22d4c944c6c06/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:29.978336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:29.980041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:29.995413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a8af1-f39b-4eba-afd0-05a4b7cff6ac admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:29.996879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d261461e12e34816a03c05f278fd6251, user_id=8c1be8ccf2f14e55a5f22d4c944c6c06, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:29.999942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:30.006800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:30.007995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.008631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.008863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] PATH_INFO: `/v3/users/9b83899feb224d709b9c6124e091298f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.010337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b83899feb224d709b9c6124e091298f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:30.012766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:30.015480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:30.102140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 984/1954] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:29 2022] PUT /identity/v3/projects/d261461e12e34816a03c05f278fd6251/users/8c1be8ccf2f14e55a5f22d4c944c6c06/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:30.103037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:30.104612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.169913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bbb76-3afd-48e0-be02-456d0d59d007 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:30.174769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:30.175701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.176049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.176417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] PATH_INFO: `/v3/projects/8a46965307364ac892610f1b4f35cbe5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.177633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a46965307364ac892610f1b4f35cbe5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:30.180200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:30.225912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b83899feb224d709b9c6124e091298f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.226552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b83899feb224d709b9c6124e091298f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.227180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b83899feb224d709b9c6124e091298f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.239053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b83899feb224d709b9c6124e091298f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.247129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6d7884fd-bf7b-4165-9c02-94c1aa799f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b83899feb224d709b9c6124e091298f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.325838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a46965307364ac892610f1b4f35cbe5', 'request_id': 'req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.335315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 971/1955] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:29 2022] DELETE /identity/v3/users/9b83899feb224d709b9c6124e091298f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:30.336454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d114d1-7e15-4fe4-a864-ac4f11a1dff3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.338205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d114d1-7e15-4fe4-a864-ac4f11a1dff3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.338503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d114d1-7e15-4fe4-a864-ac4f11a1dff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.357059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-26d114d1-7e15-4fe4-a864-ac4f11a1dff3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:30.357764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-26d114d1-7e15-4fe4-a864-ac4f11a1dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.418608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 972/1956] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:30.420040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd87b3-3c75-436f-98d9-6dff52dff8d3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.420816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd87b3-3c75-436f-98d9-6dff52dff8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.420816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd87b3-3c75-436f-98d9-6dff52dff8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.439393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7fdd87b3-3c75-436f-98d9-6dff52dff8d3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:30.440636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7fdd87b3-3c75-436f-98d9-6dff52dff8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.441414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a46965307364ac892610f1b4f35cbe5', 'request_id': 'req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.449570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 973/1957] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:30.450688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a46965307364ac892610f1b4f35cbe5', 'request_id': 'req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.450792 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd87b3-3c75-436f-98d9-6dff52dff8d3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:30.451969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7fdd87b3-3c75-436f-98d9-6dff52dff8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.466050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] The token cache is being invalidate because project 8a46965307364ac892610f1b4f35cbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:30.466507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.467678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:30.473300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 985/1958] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:30 2022] DELETE /identity/v3/projects/8a46965307364ac892610f1b4f35cbe5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:30.474681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:30.476995 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.519857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd87b3-3c75-436f-98d9-6dff52dff8d3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:30.525345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3704-40ac-4405-845c-e6a83ba3e6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:30.526295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3704-40ac-4405-845c-e6a83ba3e6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.526577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3704-40ac-4405-845c-e6a83ba3e6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.526850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3704-40ac-4405-845c-e6a83ba3e6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.529146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-44cf3704-40ac-4405-845c-e6a83ba3e6e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.542634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3704-40ac-4405-845c-e6a83ba3e6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:30.544187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3704-40ac-4405-845c-e6a83ba3e6e4 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:30.547844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c9b3f-6624-4ec9-9f49-52ec11c5b924 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:30.551807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fa8a5-7417-47a3-857f-5f89eb5cf4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:30.552493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fa8a5-7417-47a3-857f-5f89eb5cf4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.555902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 974/1959] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:30.556503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fa8a5-7417-47a3-857f-5f89eb5cf4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.556936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fa8a5-7417-47a3-857f-5f89eb5cf4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.557219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04bc37-3522-4515-9b34-4fe1be043a31 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.557506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04bc37-3522-4515-9b34-4fe1be043a31 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.557807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04bc37-3522-4515-9b34-4fe1be043a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.559180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-667fa8a5-7417-47a3-857f-5f89eb5cf4d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.573251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fa8a5-7417-47a3-857f-5f89eb5cf4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:30.576114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fa8a5-7417-47a3-857f-5f89eb5cf4d6 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:30.578979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bd04bc37-3522-4515-9b34-4fe1be043a31 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:30.580388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bd04bc37-3522-4515-9b34-4fe1be043a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.587752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 986/1960] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:30.590233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 975/1961] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:30.598315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367a8b0-2f2c-4abd-8970-e42116bc66aa None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.598954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367a8b0-2f2c-4abd-8970-e42116bc66aa None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.599387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367a8b0-2f2c-4abd-8970-e42116bc66aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.624698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7367a8b0-2f2c-4abd-8970-e42116bc66aa None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:30.625886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7367a8b0-2f2c-4abd-8970-e42116bc66aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:30.644339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 987/1962] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:30.648438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04bc37-3522-4515-9b34-4fe1be043a31 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:30.665377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04bc37-3522-4515-9b34-4fe1be043a31 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:30.666150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:30.666819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.667131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.667408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.668135 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:30.669380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:30.671063 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:30.685629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 976/1963] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:30.689739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367a8b0-2f2c-4abd-8970-e42116bc66aa None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:30.700631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367a8b0-2f2c-4abd-8970-e42116bc66aa None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:30.706082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e449a-9e2c-4b89-ba27-39d9d0bbfda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:30.706831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e449a-9e2c-4b89-ba27-39d9d0bbfda8 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.707276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e449a-9e2c-4b89-ba27-39d9d0bbfda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.707904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e449a-9e2c-4b89-ba27-39d9d0bbfda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.708649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e449a-9e2c-4b89-ba27-39d9d0bbfda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:30.710744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e449a-9e2c-4b89-ba27-39d9d0bbfda8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:30.853131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 988/1964] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:30 2022] POST /identity/v3/projects => generated 376 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:30.854605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:30.864597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b675cb-defc-4e30-9a32-92ce5f61689c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:30.953077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7352fd-60e4-4b97-b057-ad32e7c1e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:30.953882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7352fd-60e4-4b97-b057-ad32e7c1e70b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:30.954370 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7352fd-60e4-4b97-b057-ad32e7c1e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:30.954766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7352fd-60e4-4b97-b057-ad32e7c1e70b admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:30.955875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7352fd-60e4-4b97-b057-ad32e7c1e70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:30.958027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7352fd-60e4-4b97-b057-ad32e7c1e70b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.064747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 977/1965] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:30 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:31.073697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e449a-9e2c-4b89-ba27-39d9d0bbfda8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.084697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e449a-9e2c-4b89-ba27-39d9d0bbfda8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.089944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9c1f8-4749-41b2-9983-e21021f3b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.090591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c1f8-4749-41b2-9983-e21021f3b775 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.090869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c1f8-4749-41b2-9983-e21021f3b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.091139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c1f8-4749-41b2-9983-e21021f3b775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.091856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9c1f8-4749-41b2-9983-e21021f3b775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.093478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9c1f8-4749-41b2-9983-e21021f3b775 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.104437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 989/1966] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:31 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:31.108448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7352fd-60e4-4b97-b057-ad32e7c1e70b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.119193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7352fd-60e4-4b97-b057-ad32e7c1e70b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.123830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.124523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.124803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.125077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.125833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.127439 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.138113 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 978/1967] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:31 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:31.142282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9c1f8-4749-41b2-9983-e21021f3b775 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.154048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9c1f8-4749-41b2-9983-e21021f3b775 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.158817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e8bc-5b62-4bb1-9118-d8126db40d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.159763 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e8bc-5b62-4bb1-9118-d8126db40d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.160016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e8bc-5b62-4bb1-9118-d8126db40d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.160282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e8bc-5b62-4bb1-9118-d8126db40d44 admin admin] PATH_INFO: `/v3/projects/7ba63676c0bd491d9a2fbae44490edde/users/f23a530073c441f988d7275066097f31/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.179752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.180797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e8bc-5b62-4bb1-9118-d8126db40d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba63676c0bd491d9a2fbae44490edde, user_id=f23a530073c441f988d7275066097f31, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.182373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:31.183758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e8bc-5b62-4bb1-9118-d8126db40d44 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.202761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48c201-ec38-4a01-b6ab-408be4c75431 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.208409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.209281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.209614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.209831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] PATH_INFO: `/v3/projects/d2273a04a6ec4af5b95672996c50163c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.211765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2273a04a6ec4af5b95672996c50163c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.213823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.249703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 990/1968] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:31 2022] PUT /identity/v3/projects/7ba63676c0bd491d9a2fbae44490edde/users/f23a530073c441f988d7275066097f31/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:31.261035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92619a-b53e-4f8d-9921-2c827789b110 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.261325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92619a-b53e-4f8d-9921-2c827789b110 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.261608 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92619a-b53e-4f8d-9921-2c827789b110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.292170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9a92619a-b53e-4f8d-9921-2c827789b110 None None] MFA Rules not processed for user `f23a530073c441f988d7275066097f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:31.293610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9a92619a-b53e-4f8d-9921-2c827789b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:31.371321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2273a04a6ec4af5b95672996c50163c', 'request_id': 'req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.373055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 991/1969] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:31.376729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92619a-b53e-4f8d-9921-2c827789b110 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.459755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2273a04a6ec4af5b95672996c50163c', 'request_id': 'req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.464432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92619a-b53e-4f8d-9921-2c827789b110 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.472252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2273a04a6ec4af5b95672996c50163c', 'request_id': 'req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.490351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] The token cache is being invalidate because project d2273a04a6ec4af5b95672996c50163c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:31.497502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.497502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:31.497502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 979/1970] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:31 2022] DELETE /identity/v3/projects/d2273a04a6ec4af5b95672996c50163c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:31.500470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.502737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:31.527932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.528718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.529086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.529431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.530185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.532253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.628006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 992/1971] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:31 2022] POST /identity/v3/projects => generated 374 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:31.634768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.635987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3aae4-467f-4ea4-98d3-b8a34a5decb9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.637334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:31.753716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:31.759295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.762495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.763746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.765403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] PATH_INFO: `/v3/users/e3c475e08a5b4492870684df38961f08` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.767177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c475e08a5b4492870684df38961f08)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.774576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.789181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88909-39a6-48c0-ac5f-17abba09ffe5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.792940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9641b7-736d-4a77-bc0d-6e320c0b2ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.793806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9641b7-736d-4a77-bc0d-6e320c0b2ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.794092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9641b7-736d-4a77-bc0d-6e320c0b2ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.794363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9641b7-736d-4a77-bc0d-6e320c0b2ffb admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.795198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9641b7-736d-4a77-bc0d-6e320c0b2ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.797220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9641b7-736d-4a77-bc0d-6e320c0b2ffb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.931328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 993/1972] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:31 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:31.933757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9641b7-736d-4a77-bc0d-6e320c0b2ffb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.943939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9641b7-736d-4a77-bc0d-6e320c0b2ffb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.950931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f093e-ad8e-4509-a9b4-ce765a345473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.950931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f093e-ad8e-4509-a9b4-ce765a345473 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.950931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f093e-ad8e-4509-a9b4-ce765a345473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.951411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f093e-ad8e-4509-a9b4-ce765a345473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:31.952208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f093e-ad8e-4509-a9b4-ce765a345473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:31.953935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f093e-ad8e-4509-a9b4-ce765a345473 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:31.964816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 994/1973] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:31 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:31.968893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f093e-ad8e-4509-a9b4-ce765a345473 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:31.979557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f093e-ad8e-4509-a9b4-ce765a345473 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:31.989462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:31.989462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:31.989462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:31.989462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] PATH_INFO: `/v3/projects/f33becb77dce4a8e8cc81a6ae2788baa/users/f75964128fbf4aae9a4b1cef597cc7e2/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:32.025597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33becb77dce4a8e8cc81a6ae2788baa, user_id=f75964128fbf4aae9a4b1cef597cc7e2, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:32.026962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c475e08a5b4492870684df38961f08'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.027627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c475e08a5b4492870684df38961f08'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.028241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c475e08a5b4492870684df38961f08'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.031305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:32.050692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c475e08a5b4492870684df38961f08'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.058113 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c475e08a5b4492870684df38961f08'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:32.152402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 995/1974] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:31 2022] PUT /identity/v3/projects/f33becb77dce4a8e8cc81a6ae2788baa/users/f75964128fbf4aae9a4b1cef597cc7e2/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:32.155852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:32.157691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:32.188395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 980/1975] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:31 2022] DELETE /identity/v3/users/e3c475e08a5b4492870684df38961f08 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:32.209625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:32.256463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44835724-e521-45d9-967d-bbc2b0aeb63f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:32.352978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bc02e-5cb3-4da5-868e-5bc8c803e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:32.363203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bc02e-5cb3-4da5-868e-5bc8c803e863 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:32.363203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bc02e-5cb3-4da5-868e-5bc8c803e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:32.363203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bc02e-5cb3-4da5-868e-5bc8c803e863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:32.363203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bc02e-5cb3-4da5-868e-5bc8c803e863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:32.363203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bc02e-5cb3-4da5-868e-5bc8c803e863 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:32.371405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 996/1976] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:32 2022] GET /identity/v3/roles => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:32.372854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:32.383932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976bdfb-2722-44ab-a976-d34d1ef6210d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:32.389831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:32.390831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:32.391139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:32.391419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] PATH_INFO: `/v3/projects/f33becb77dce4a8e8cc81a6ae2788baa/users/f75964128fbf4aae9a4b1cef597cc7e2/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:32.393555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33becb77dce4a8e8cc81a6ae2788baa, user_id=f75964128fbf4aae9a4b1cef597cc7e2, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:32.396378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:32.408890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 981/1977] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:32 2022] PUT /identity/v3/projects/f33becb77dce4a8e8cc81a6ae2788baa/users/f75964128fbf4aae9a4b1cef597cc7e2/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:32.420675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947285-fae2-4e39-980e-e7a0a1a630f1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:32.420998 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947285-fae2-4e39-980e-e7a0a1a630f1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:32.421244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947285-fae2-4e39-980e-e7a0a1a630f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:32.464985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0d947285-fae2-4e39-980e-e7a0a1a630f1 None None] MFA Rules not processed for user `f75964128fbf4aae9a4b1cef597cc7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:32.466344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0d947285-fae2-4e39-980e-e7a0a1a630f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:32.564743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 997/1978] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:32.579122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:32.581025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:32.664064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392120-2af6-40f5-88e0-8f57ebf2afe4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:32.670270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3ee43-cce3-433a-82e7-416f9081f3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:32.670946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ee43-cce3-433a-82e7-416f9081f3cf service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:32.671307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ee43-cce3-433a-82e7-416f9081f3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:32.671592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ee43-cce3-433a-82e7-416f9081f3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:32.673457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f9a3ee43-cce3-433a-82e7-416f9081f3cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:32.690592 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d947285-fae2-4e39-980e-e7a0a1a630f1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:32.692016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0d947285-fae2-4e39-980e-e7a0a1a630f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:32.787212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3ee43-cce3-433a-82e7-416f9081f3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:32.790850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3ee43-cce3-433a-82e7-416f9081f3cf service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:32.802556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d947285-fae2-4e39-980e-e7a0a1a630f1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:32.803738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 982/1979] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:32.819388 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:32.820459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:32.820849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:32.821219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] PATH_INFO: `/v3/projects/9c95d1059b6249b7974226585e72b15c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:32.822591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c95d1059b6249b7974226585e72b15c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:32.830149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:32.997460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c95d1059b6249b7974226585e72b15c', 'request_id': 'req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:33.136036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c95d1059b6249b7974226585e72b15c', 'request_id': 'req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:33.147924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c95d1059b6249b7974226585e72b15c', 'request_id': 'req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:33.165360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] The token cache is being invalidate because project 9c95d1059b6249b7974226585e72b15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:33.165656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:33.166360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bf8df7f5-d1e8-4418-bf22-ef36b27aaca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:33.168925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 998/1980] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:32 2022] DELETE /identity/v3/projects/9c95d1059b6249b7974226585e72b15c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:33.174114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60174b7-7c18-41cd-8adf-ac2e42cdbe51 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.174416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60174b7-7c18-41cd-8adf-ac2e42cdbe51 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.174686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60174b7-7c18-41cd-8adf-ac2e42cdbe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.195706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f60174b7-7c18-41cd-8adf-ac2e42cdbe51 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:33.197466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f60174b7-7c18-41cd-8adf-ac2e42cdbe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:33.284057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374696-43f6-4f85-bbbb-a47331f9bb49 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.284057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374696-43f6-4f85-bbbb-a47331f9bb49 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.284057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374696-43f6-4f85-bbbb-a47331f9bb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.291613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 983/1981] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:33.339723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c1374696-43f6-4f85-bbbb-a47331f9bb49 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:33.341182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c1374696-43f6-4f85-bbbb-a47331f9bb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:33.351672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 999/1982] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:33.356129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60174b7-7c18-41cd-8adf-ac2e42cdbe51 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:33.371839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60174b7-7c18-41cd-8adf-ac2e42cdbe51 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:33.389792 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:33.390459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.390745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.391202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.391947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:33.392481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:33.399849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:33.416173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 984/1983] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:33.421201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1374696-43f6-4f85-bbbb-a47331f9bb49 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:33.436005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1374696-43f6-4f85-bbbb-a47331f9bb49 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:33.442282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b6b11-3678-4b13-a14f-c41829cddc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:33.443240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6b11-3678-4b13-a14f-c41829cddc0c admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.443621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6b11-3678-4b13-a14f-c41829cddc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.443979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6b11-3678-4b13-a14f-c41829cddc0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.446000 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b6b11-3678-4b13-a14f-c41829cddc0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:33.451549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b6b11-3678-4b13-a14f-c41829cddc0c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:33.598515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1000/1984] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:33 2022] POST /identity/v3/projects => generated 386 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:33.602832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:33.612765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6df22-6b70-42e0-8cb8-37ce955c54ae admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:33.676644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:33.692650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f70bc-102d-439b-aef8-0eb37558be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:33.693492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f70bc-102d-439b-aef8-0eb37558be47 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.694010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f70bc-102d-439b-aef8-0eb37558be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.694399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f70bc-102d-439b-aef8-0eb37558be47 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.695173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f70bc-102d-439b-aef8-0eb37558be47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:33.699360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f70bc-102d-439b-aef8-0eb37558be47 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:33.804863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 985/1985] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:33 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:33.809025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b6b11-3678-4b13-a14f-c41829cddc0c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:33.829869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b6b11-3678-4b13-a14f-c41829cddc0c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:33.837619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab6877-e604-4ecd-95a0-bb359b42a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:33.838572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6877-e604-4ecd-95a0-bb359b42a199 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.839229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6877-e604-4ecd-95a0-bb359b42a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.839747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6877-e604-4ecd-95a0-bb359b42a199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.841214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab6877-e604-4ecd-95a0-bb359b42a199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:33.844476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab6877-e604-4ecd-95a0-bb359b42a199 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:33.856196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1001/1986] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:33 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:33.860478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f70bc-102d-439b-aef8-0eb37558be47 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:33.871683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f70bc-102d-439b-aef8-0eb37558be47 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:33.876858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:33.877346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.877795 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.878226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.878953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:33.881356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:33.893991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 986/1987] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:33 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:33.898329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab6877-e604-4ecd-95a0-bb359b42a199 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:33.904278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:33.907293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:33.909331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab6877-e604-4ecd-95a0-bb359b42a199 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:33.921043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f2697-3a6a-4a7d-aec6-886db6861cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:33.921937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2697-3a6a-4a7d-aec6-886db6861cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.922213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2697-3a6a-4a7d-aec6-886db6861cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.922481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f2697-3a6a-4a7d-aec6-886db6861cab admin admin] PATH_INFO: `/v3/projects/4e914c7dd24a425394ab306ba5a40e32/users/15ce650dc8854cc7be4936488efab0f8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.924704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026de01-0b78-486d-b346-3d25f1936792 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:33.930894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:33.932236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.932717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.933319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] PATH_INFO: `/v3/users/c49cfdd6c17a495c99007cc63e1e1566` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.934751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49cfdd6c17a495c99007cc63e1e1566)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:33.937261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:33.938735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f2697-3a6a-4a7d-aec6-886db6861cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e914c7dd24a425394ab306ba5a40e32, user_id=15ce650dc8854cc7be4936488efab0f8, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:33.941536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f2697-3a6a-4a7d-aec6-886db6861cab admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:34.041098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1002/1988] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:33 2022] PUT /identity/v3/projects/4e914c7dd24a425394ab306ba5a40e32/users/15ce650dc8854cc7be4936488efab0f8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:34.051384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b24af-13f3-4639-9ddf-7bc04743aea9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:34.051987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b24af-13f3-4639-9ddf-7bc04743aea9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:34.052545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b24af-13f3-4639-9ddf-7bc04743aea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:34.073161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:34.088984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f91b24af-13f3-4639-9ddf-7bc04743aea9 None None] MFA Rules not processed for user `15ce650dc8854cc7be4936488efab0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:34.090625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f91b24af-13f3-4639-9ddf-7bc04743aea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:34.177892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49cfdd6c17a495c99007cc63e1e1566'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:34.177892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49cfdd6c17a495c99007cc63e1e1566'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:34.177892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49cfdd6c17a495c99007cc63e1e1566'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:34.194993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49cfdd6c17a495c99007cc63e1e1566'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:34.197996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1003/1989] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:34.203051 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b24af-13f3-4639-9ddf-7bc04743aea9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:34.204839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f91b24af-13f3-4639-9ddf-7bc04743aea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:34.208254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ca95a4-1cb0-4cb7-8784-82b1db88cb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49cfdd6c17a495c99007cc63e1e1566'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:34.286611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 987/1990] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:33 2022] DELETE /identity/v3/users/c49cfdd6c17a495c99007cc63e1e1566 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:34.286611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21397cb-179b-4278-80c8-6a06efbcbc86 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:34.286611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21397cb-179b-4278-80c8-6a06efbcbc86 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:34.286611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21397cb-179b-4278-80c8-6a06efbcbc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:34.304203 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b24af-13f3-4639-9ddf-7bc04743aea9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:34.340494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d21397cb-179b-4278-80c8-6a06efbcbc86 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:34.342071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d21397cb-179b-4278-80c8-6a06efbcbc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:34.387374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809dac1-30dd-43b5-b8b0-ffb1ae014958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:34.388197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809dac1-30dd-43b5-b8b0-ffb1ae014958 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:34.389187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809dac1-30dd-43b5-b8b0-ffb1ae014958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:34.389301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809dac1-30dd-43b5-b8b0-ffb1ae014958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:34.390013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809dac1-30dd-43b5-b8b0-ffb1ae014958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:34.393703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809dac1-30dd-43b5-b8b0-ffb1ae014958 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:34.425259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 988/1991] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:34.437160 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21397cb-179b-4278-80c8-6a06efbcbc86 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:34.438639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d21397cb-179b-4278-80c8-6a06efbcbc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:34.516578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21397cb-179b-4278-80c8-6a06efbcbc86 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:34.520846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c341-521c-44f2-beb4-abcab9a392df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:34.521538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c341-521c-44f2-beb4-abcab9a392df service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:34.521839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c341-521c-44f2-beb4-abcab9a392df service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:34.522151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c341-521c-44f2-beb4-abcab9a392df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:34.533521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978c341-521c-44f2-beb4-abcab9a392df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:34.535388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978c341-521c-44f2-beb4-abcab9a392df service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:34.546633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 989/1992] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:34.593146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1004/1993] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:34 2022] POST /identity/v3/projects => generated 382 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:34.597671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c341-521c-44f2-beb4-abcab9a392df service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:34.609599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c341-521c-44f2-beb4-abcab9a392df service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:34.691801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4799a-b8fd-416a-9e99-54673d45bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:34.692520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4799a-b8fd-416a-9e99-54673d45bf01 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:34.692810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4799a-b8fd-416a-9e99-54673d45bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:34.693088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4799a-b8fd-416a-9e99-54673d45bf01 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:34.693803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4799a-b8fd-416a-9e99-54673d45bf01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:34.696437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4799a-b8fd-416a-9e99-54673d45bf01 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:34.784683 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 990/1994] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:34 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:34.785788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809dac1-30dd-43b5-b8b0-ffb1ae014958 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:34.797621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809dac1-30dd-43b5-b8b0-ffb1ae014958 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:34.803492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100806f4-5ba7-42c5-b84e-b21f1cd4d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:34.805291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100806f4-5ba7-42c5-b84e-b21f1cd4d165 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:34.805291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100806f4-5ba7-42c5-b84e-b21f1cd4d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:34.805600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100806f4-5ba7-42c5-b84e-b21f1cd4d165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:34.806356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100806f4-5ba7-42c5-b84e-b21f1cd4d165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:34.807985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100806f4-5ba7-42c5-b84e-b21f1cd4d165 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:34.821181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1005/1995] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:34 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:34.825787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4799a-b8fd-416a-9e99-54673d45bf01 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:34.837281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4799a-b8fd-416a-9e99-54673d45bf01 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:34.842182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f87bef-e67f-4312-b29e-b33df162f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:34.843078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f87bef-e67f-4312-b29e-b33df162f2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:34.843357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f87bef-e67f-4312-b29e-b33df162f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:34.843627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f87bef-e67f-4312-b29e-b33df162f2d0 admin admin] PATH_INFO: `/v3/projects/0dc1d74d30a642af95e30e4aaaf5ad36/users/27ea67c46e1e43df9ca114cf5610ce56/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:34.862475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f87bef-e67f-4312-b29e-b33df162f2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc1d74d30a642af95e30e4aaaf5ad36, user_id=27ea67c46e1e43df9ca114cf5610ce56, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:34.865421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f87bef-e67f-4312-b29e-b33df162f2d0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:34.972668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 991/1996] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:34 2022] PUT /identity/v3/projects/0dc1d74d30a642af95e30e4aaaf5ad36/users/27ea67c46e1e43df9ca114cf5610ce56/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:34.974059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100806f4-5ba7-42c5-b84e-b21f1cd4d165 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:34.985762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100806f4-5ba7-42c5-b84e-b21f1cd4d165 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:35.080540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6f8f1-7098-40aa-abd7-a49cc46abf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:35.081386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6f8f1-7098-40aa-abd7-a49cc46abf95 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:35.081673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6f8f1-7098-40aa-abd7-a49cc46abf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:35.081951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6f8f1-7098-40aa-abd7-a49cc46abf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:35.087625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6f8f1-7098-40aa-abd7-a49cc46abf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:35.091333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6f8f1-7098-40aa-abd7-a49cc46abf95 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:35.108327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1006/1997] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:34 2022] GET /identity/v3/roles => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:35.109667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f87bef-e67f-4312-b29e-b33df162f2d0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:35.128484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f87bef-e67f-4312-b29e-b33df162f2d0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:35.134766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:35.135818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:35.136255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:35.136907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] PATH_INFO: `/v3/projects/0dc1d74d30a642af95e30e4aaaf5ad36/users/27ea67c46e1e43df9ca114cf5610ce56/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:35.139973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc1d74d30a642af95e30e4aaaf5ad36, user_id=27ea67c46e1e43df9ca114cf5610ce56, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:35.143745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:35.160468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 992/1998] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:35 2022] PUT /identity/v3/projects/0dc1d74d30a642af95e30e4aaaf5ad36/users/27ea67c46e1e43df9ca114cf5610ce56/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:35.178437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82035f5a-3f32-4f3e-ad91-82e6455830d4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:35.178748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82035f5a-3f32-4f3e-ad91-82e6455830d4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:35.179122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82035f5a-3f32-4f3e-ad91-82e6455830d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:35.242707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:35.257969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-82035f5a-3f32-4f3e-ad91-82e6455830d4 None None] MFA Rules not processed for user `27ea67c46e1e43df9ca114cf5610ce56`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:35.264846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-82035f5a-3f32-4f3e-ad91-82e6455830d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:35.464473 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1007/1999] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:35.478694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:35.481343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:35.520836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82035f5a-3f32-4f3e-ad91-82e6455830d4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:35.522418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-82035f5a-3f32-4f3e-ad91-82e6455830d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:35.609567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66760-60b3-428e-a3af-1277841f97c4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:35.615872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acee77e-632c-4d62-9892-8dba1b8a9aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:35.618065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acee77e-632c-4d62-9892-8dba1b8a9aca service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:35.618471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acee77e-632c-4d62-9892-8dba1b8a9aca service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:35.619694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acee77e-632c-4d62-9892-8dba1b8a9aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:35.660025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82035f5a-3f32-4f3e-ad91-82e6455830d4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:35.665125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:35.666010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:35.667945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:35.667945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] PATH_INFO: `/v3/projects/60fc9959fd0b4f24a9041838db01e3bd` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:35.669226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fc9959fd0b4f24a9041838db01e3bd)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:35.671276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:35.745899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acee77e-632c-4d62-9892-8dba1b8a9aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:35.747920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acee77e-632c-4d62-9892-8dba1b8a9aca service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:35.764600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 993/2000] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:35.812461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fc9959fd0b4f24a9041838db01e3bd', 'request_id': 'req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:35.915783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fc9959fd0b4f24a9041838db01e3bd', 'request_id': 'req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:35.924643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fc9959fd0b4f24a9041838db01e3bd', 'request_id': 'req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:35.940956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] The token cache is being invalidate because project 60fc9959fd0b4f24a9041838db01e3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:35.941338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:35.942185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:35.944803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1008/2001] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:35 2022] DELETE /identity/v3/projects/60fc9959fd0b4f24a9041838db01e3bd => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:35.949927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acee77e-632c-4d62-9892-8dba1b8a9aca service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:35.964985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acee77e-632c-4d62-9892-8dba1b8a9aca service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:36.052689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:36.053603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:36.054736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:36.055023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] PATH_INFO: `/v3/users/68a963275b4d4394ae72471d83259b35` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:36.056289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a963275b4d4394ae72471d83259b35)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:36.060007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:36.107993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:36.310945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a963275b4d4394ae72471d83259b35'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.311639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a963275b4d4394ae72471d83259b35'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.312257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a963275b4d4394ae72471d83259b35'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.347230 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a963275b4d4394ae72471d83259b35'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.375698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db9b99f9-c56a-4a1f-969a-1840dfd9c360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a963275b4d4394ae72471d83259b35'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.418596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:36.420327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:36.440202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a2b72-ab30-4598-b6b1-95cd12f9bbba admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:36.446503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:36.447507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:36.447846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:36.451262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] PATH_INFO: `/v3/users/f23a530073c441f988d7275066097f31` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:36.451262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23a530073c441f988d7275066097f31)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:36.453283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:36.501385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 994/2002] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:35 2022] DELETE /identity/v3/users/68a963275b4d4394ae72471d83259b35 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:36.683704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23a530073c441f988d7275066097f31'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.684436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23a530073c441f988d7275066097f31'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.685571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23a530073c441f988d7275066097f31'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.715663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23a530073c441f988d7275066097f31'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.736787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23a530073c441f988d7275066097f31'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:36.825487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1009/2003] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:36 2022] DELETE /identity/v3/users/f23a530073c441f988d7275066097f31 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:36.831316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8059-9022-4e25-9430-4b3494cfebe3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:36.831794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8059-9022-4e25-9430-4b3494cfebe3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:36.832216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8059-9022-4e25-9430-4b3494cfebe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:36.873090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f3dc8059-9022-4e25-9430-4b3494cfebe3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:36.877218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f3dc8059-9022-4e25-9430-4b3494cfebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:36.999642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 995/2004] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:37.009652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:37.011325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:37.052040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc8059-9022-4e25-9430-4b3494cfebe3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:37.053519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f3dc8059-9022-4e25-9430-4b3494cfebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:37.093468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e44d-a2d1-4980-a15e-e299e248ffcd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:37.096847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc8059-9022-4e25-9430-4b3494cfebe3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:37.097724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4296f0-ab10-4ca1-9441-023e894e6873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:37.098549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4296f0-ab10-4ca1-9441-023e894e6873 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:37.099075 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4296f0-ab10-4ca1-9441-023e894e6873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:37.099428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4296f0-ab10-4ca1-9441-023e894e6873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:37.112421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:37.113457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:37.113746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:37.114023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] PATH_INFO: `/v3/projects/7521d79e71c84849a727091f4caf94eb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:37.118475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7521d79e71c84849a727091f4caf94eb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:37.127308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4296f0-ab10-4ca1-9441-023e894e6873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:37.136735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4296f0-ab10-4ca1-9441-023e894e6873 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:37.138553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:37.166702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1010/2005] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:37.349664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7521d79e71c84849a727091f4caf94eb', 'request_id': 'req-f4a4b25f-2db0-4227-9203-4117604e4343'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:37.442279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7521d79e71c84849a727091f4caf94eb', 'request_id': 'req-f4a4b25f-2db0-4227-9203-4117604e4343'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:37.445882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:37.454803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7521d79e71c84849a727091f4caf94eb', 'request_id': 'req-f4a4b25f-2db0-4227-9203-4117604e4343'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:37.483964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] The token cache is being invalidate because project 7521d79e71c84849a727091f4caf94eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:37.484284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:37.486806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4a4b25f-2db0-4227-9203-4117604e4343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:37.489044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 996/2006] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:37 2022] DELETE /identity/v3/projects/7521d79e71c84849a727091f4caf94eb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:37.494109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03b7d-8b15-4b06-a90d-1133d7b4b606 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:37.494621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03b7d-8b15-4b06-a90d-1133d7b4b606 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:37.495139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03b7d-8b15-4b06-a90d-1133d7b4b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:37.539622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ade03b7d-8b15-4b06-a90d-1133d7b4b606 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:37.543244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ade03b7d-8b15-4b06-a90d-1133d7b4b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:37.695183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1011/2007] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:37.699016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d883d6-2ef1-4421-8530-4904cb11d6eb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:37.699834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d883d6-2ef1-4421-8530-4904cb11d6eb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:37.700384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d883d6-2ef1-4421-8530-4904cb11d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:37.732881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03b7d-8b15-4b06-a90d-1133d7b4b606 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:37.733918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a3d883d6-2ef1-4421-8530-4904cb11d6eb None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:37.734911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ade03b7d-8b15-4b06-a90d-1133d7b4b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:37.737256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a3d883d6-2ef1-4421-8530-4904cb11d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:37.750553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 997/2008] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:37.755805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d883d6-2ef1-4421-8530-4904cb11d6eb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:37.762937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03b7d-8b15-4b06-a90d-1133d7b4b606 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:37.768435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d883d6-2ef1-4421-8530-4904cb11d6eb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:37.769734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:37.771414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:37.771845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:37.772284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] PATH_INFO: `/v3/projects/7ba63676c0bd491d9a2fbae44490edde` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:37.775385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba63676c0bd491d9a2fbae44490edde)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:37.776801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:37.777501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:37.777607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:37.778627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:37.779254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:37.780717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:37.781180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:37.783783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:37.801035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 998/2009] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:37.807307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:37.821348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53ddb5-d5a9-4d3c-9d9b-898a573878ee admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:37.827016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc829ab-3649-473b-b24a-92a75aaa3adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:37.827689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc829ab-3649-473b-b24a-92a75aaa3adc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:37.828217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc829ab-3649-473b-b24a-92a75aaa3adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:37.828604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc829ab-3649-473b-b24a-92a75aaa3adc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:37.829307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc829ab-3649-473b-b24a-92a75aaa3adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:37.831634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc829ab-3649-473b-b24a-92a75aaa3adc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:37.935426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 999/2010] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:37 2022] POST /identity/v3/projects => generated 378 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:37.936833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640f175-98b4-4175-ac04-f251c23dc642 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:37.937257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640f175-98b4-4175-ac04-f251c23dc642 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:37.937547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640f175-98b4-4175-ac04-f251c23dc642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:37.951078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba63676c0bd491d9a2fbae44490edde', 'request_id': 'req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:37.968749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b640f175-98b4-4175-ac04-f251c23dc642 None None] MFA Rules not processed for user `8c1be8ccf2f14e55a5f22d4c944c6c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:37.970134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b640f175-98b4-4175-ac04-f251c23dc642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:38.033341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba63676c0bd491d9a2fbae44490edde', 'request_id': 'req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.038401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1000/2011] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:38.038401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640f175-98b4-4175-ac04-f251c23dc642 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:38.051919 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba63676c0bd491d9a2fbae44490edde', 'request_id': 'req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.067106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] The token cache is being invalidate because project 7ba63676c0bd491d9a2fbae44490edde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:38.067399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.068062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.070517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1012/2012] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:37 2022] DELETE /identity/v3/projects/7ba63676c0bd491d9a2fbae44490edde => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:38.071525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:38.074921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:38.114644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640f175-98b4-4175-ac04-f251c23dc642 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:38.119371 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:38.120079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.120383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.120803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.121498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:38.123708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:38.167164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537b6c6-4fc8-40ad-8b9e-cb5e18eacbe0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:38.240353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1001/2013] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:38 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:38.240353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:38.240353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:38.245582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:38.246269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.246550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.247009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.248873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:38.251796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffb98b-18e0-4fa1-85bc-ca34ff4ec0ca admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:38.256397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:38.258654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.258942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.259216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] PATH_INFO: `/v3/users/f75964128fbf4aae9a4b1cef597cc7e2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.260480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75964128fbf4aae9a4b1cef597cc7e2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:38.260605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:38.262174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:38.262507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:38.271493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1013/2014] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:38.274037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:38.276055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:38.297143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cbe99-e57a-4141-97d8-2b6fe1d98852 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:38.305343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95cb5f-86b4-497d-911c-59dcbd172431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:38.306020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95cb5f-86b4-497d-911c-59dcbd172431 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.306297 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95cb5f-86b4-497d-911c-59dcbd172431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.306571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95cb5f-86b4-497d-911c-59dcbd172431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.307301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95cb5f-86b4-497d-911c-59dcbd172431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:38.308914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95cb5f-86b4-497d-911c-59dcbd172431 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:38.319199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1014/2015] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:38 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:38.324279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95cb5f-86b4-497d-911c-59dcbd172431 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:38.334211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95cb5f-86b4-497d-911c-59dcbd172431 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:38.339789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f3fb-fb4e-445e-85df-69aa986a9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:38.340497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f3fb-fb4e-445e-85df-69aa986a9b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.340778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f3fb-fb4e-445e-85df-69aa986a9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.341049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f3fb-fb4e-445e-85df-69aa986a9b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.341764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1f3fb-fb4e-445e-85df-69aa986a9b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:38.343530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1f3fb-fb4e-445e-85df-69aa986a9b32 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:38.354917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1015/2016] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:38 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:38.359166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f3fb-fb4e-445e-85df-69aa986a9b32 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:38.370026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f3fb-fb4e-445e-85df-69aa986a9b32 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:38.375474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a86578-2052-485b-9a3b-d991023fa9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:38.376401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86578-2052-485b-9a3b-d991023fa9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.382327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86578-2052-485b-9a3b-d991023fa9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.382327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86578-2052-485b-9a3b-d991023fa9fd admin admin] PATH_INFO: `/v3/projects/f4bfd7b1466140b7b0f4311668585646/users/242f76896ad34b1f9d27e7c6e6ecec88/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.393769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86578-2052-485b-9a3b-d991023fa9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bfd7b1466140b7b0f4311668585646, user_id=242f76896ad34b1f9d27e7c6e6ecec88, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:38.396483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86578-2052-485b-9a3b-d991023fa9fd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:38.498725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75964128fbf4aae9a4b1cef597cc7e2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.499386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75964128fbf4aae9a4b1cef597cc7e2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.499989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75964128fbf4aae9a4b1cef597cc7e2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.513883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75964128fbf4aae9a4b1cef597cc7e2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.521016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75964128fbf4aae9a4b1cef597cc7e2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:38.532041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:38.539821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1016/2017] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:38 2022] PUT /identity/v3/projects/f4bfd7b1466140b7b0f4311668585646/users/242f76896ad34b1f9d27e7c6e6ecec88/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:38.554430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523bddc-c61e-45e5-9be7-898465269f6a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.554712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523bddc-c61e-45e5-9be7-898465269f6a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.554987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523bddc-c61e-45e5-9be7-898465269f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.586270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c523bddc-c61e-45e5-9be7-898465269f6a None None] MFA Rules not processed for user `242f76896ad34b1f9d27e7c6e6ecec88`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:38.590996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c523bddc-c61e-45e5-9be7-898465269f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:38.624149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1002/2018] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:38 2022] DELETE /identity/v3/users/f75964128fbf4aae9a4b1cef597cc7e2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:38.734759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1017/2019] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:38.739043 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:38.740914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:38.812021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889cd0d-1ae3-4b5a-8e08-0280c13d8ae6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:38.818067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:38.818834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.821023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.821672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.822584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:38.829549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:38.936777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1003/2020] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:38 2022] POST /identity/v3/projects => generated 376 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:38.937832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523bddc-c61e-45e5-9be7-898465269f6a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:39.018561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523bddc-c61e-45e5-9be7-898465269f6a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:39.110884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad6a08-d1c0-4174-a40f-d655675359a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:39.111877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6a08-d1c0-4174-a40f-d655675359a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.112717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6a08-d1c0-4174-a40f-d655675359a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.113106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6a08-d1c0-4174-a40f-d655675359a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.114052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad6a08-d1c0-4174-a40f-d655675359a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:39.118568 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad6a08-d1c0-4174-a40f-d655675359a6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:39.193803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:39.198803 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:39.212957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f0639-6e70-4356-b9ae-bf4e7b8fa563 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:39.218002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:39.218916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.219688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.219688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] PATH_INFO: `/v3/projects/f33becb77dce4a8e8cc81a6ae2788baa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.220921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33becb77dce4a8e8cc81a6ae2788baa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:39.222883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:39.251252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1018/2021] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:38 2022] POST /identity/v3/users => generated 289 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:39.254810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad6a08-d1c0-4174-a40f-d655675359a6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:39.273143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad6a08-d1c0-4174-a40f-d655675359a6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:39.278794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453610d-33b1-4f05-bb6f-3f0a24cce16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:39.279694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453610d-33b1-4f05-bb6f-3f0a24cce16a admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.279996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453610d-33b1-4f05-bb6f-3f0a24cce16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.280262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453610d-33b1-4f05-bb6f-3f0a24cce16a admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.281020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453610d-33b1-4f05-bb6f-3f0a24cce16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:39.282647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453610d-33b1-4f05-bb6f-3f0a24cce16a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:39.298337 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1019/2022] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:39 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:39.301978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453610d-33b1-4f05-bb6f-3f0a24cce16a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:39.318376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453610d-33b1-4f05-bb6f-3f0a24cce16a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:39.328960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748290f6-9c12-4414-a61b-f2e6d06e4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:39.329468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748290f6-9c12-4414-a61b-f2e6d06e4b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.329749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748290f6-9c12-4414-a61b-f2e6d06e4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.330035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748290f6-9c12-4414-a61b-f2e6d06e4b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.330769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748290f6-9c12-4414-a61b-f2e6d06e4b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:39.332390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748290f6-9c12-4414-a61b-f2e6d06e4b7e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:39.349063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1020/2023] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:39 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:39.355591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33becb77dce4a8e8cc81a6ae2788baa', 'request_id': 'req-973ae36d-7374-4c5d-95bc-ba454a1fd351'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:39.359680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748290f6-9c12-4414-a61b-f2e6d06e4b7e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:39.369502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748290f6-9c12-4414-a61b-f2e6d06e4b7e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:39.455647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:39.456573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.456858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.457135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] PATH_INFO: `/v3/projects/f60933129b9e49a8a5d32a4db76ed82d/users/69db0f4cd2054d4db518631efab09947/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.473567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33becb77dce4a8e8cc81a6ae2788baa', 'request_id': 'req-973ae36d-7374-4c5d-95bc-ba454a1fd351'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:39.474849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60933129b9e49a8a5d32a4db76ed82d, user_id=69db0f4cd2054d4db518631efab09947, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:39.480434 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:39.506287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33becb77dce4a8e8cc81a6ae2788baa', 'request_id': 'req-973ae36d-7374-4c5d-95bc-ba454a1fd351'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:39.519193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] The token cache is being invalidate because project f33becb77dce4a8e8cc81a6ae2788baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:39.519471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:39.520219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-973ae36d-7374-4c5d-95bc-ba454a1fd351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:39.522117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1004/2024] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:39 2022] DELETE /identity/v3/projects/f33becb77dce4a8e8cc81a6ae2788baa => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:39.527185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59d47-4a3b-4d56-86bf-10d15984e91e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.527473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59d47-4a3b-4d56-86bf-10d15984e91e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.527752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59d47-4a3b-4d56-86bf-10d15984e91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.548280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-91c59d47-4a3b-4d56-86bf-10d15984e91e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:39.549520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-91c59d47-4a3b-4d56-86bf-10d15984e91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:39.562761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1005/2025] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:39.571365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc77ba-5ece-403d-9ddd-51e1d21b18a0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.572952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc77ba-5ece-403d-9ddd-51e1d21b18a0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.573296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc77ba-5ece-403d-9ddd-51e1d21b18a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.594553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1021/2026] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:39 2022] PUT /identity/v3/projects/f60933129b9e49a8a5d32a4db76ed82d/users/69db0f4cd2054d4db518631efab09947/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:39.595772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:39.600241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:39.613654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-45bc77ba-5ece-403d-9ddd-51e1d21b18a0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:39.614859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-45bc77ba-5ece-403d-9ddd-51e1d21b18a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:39.732048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1006/2027] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:39.734191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2be11c-58fb-42d8-a921-c62ca3701503 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.734485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2be11c-58fb-42d8-a921-c62ca3701503 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.734826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2be11c-58fb-42d8-a921-c62ca3701503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.743646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8145b28-98ae-4bd8-84b1-7af9d06d6380 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:39.749438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:39.750521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.751042 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.755451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] PATH_INFO: `/v3/users/754166c3ca9c4b4185c2f8a087957478` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.757695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754166c3ca9c4b4185c2f8a087957478)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:39.759859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:39.808890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aa2be11c-58fb-42d8-a921-c62ca3701503 None None] MFA Rules not processed for user `69db0f4cd2054d4db518631efab09947`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:39.810801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aa2be11c-58fb-42d8-a921-c62ca3701503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:39.883358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1007/2028] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:39.885861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2be11c-58fb-42d8-a921-c62ca3701503 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:39.887967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:39.904926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2be11c-58fb-42d8-a921-c62ca3701503 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:39.909795 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:39.910449 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.913064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.913064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.913064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:39.913064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:39.913774 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:39.930849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1008/2029] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:39.930849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:39.931729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:39.945329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73196e-d193-4876-be9c-34703218b17b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:39.950056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:39.950704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.950984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.951431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.952123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:39.954082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.007778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754166c3ca9c4b4185c2f8a087957478'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:40.008632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754166c3ca9c4b4185c2f8a087957478'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:40.009296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754166c3ca9c4b4185c2f8a087957478'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:40.026703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754166c3ca9c4b4185c2f8a087957478'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:40.033389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754166c3ca9c4b4185c2f8a087957478'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:40.048834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1009/2030] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:39 2022] POST /identity/v3/projects => generated 376 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:40.049661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.051781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:40.127940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81e24-2f7c-4644-8c87-8fada79d1924 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.135261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577903d-2791-48ed-bff5-534cd6b3e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.136110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577903d-2791-48ed-bff5-534cd6b3e1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.137087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577903d-2791-48ed-bff5-534cd6b3e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.137369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577903d-2791-48ed-bff5-534cd6b3e1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.138228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577903d-2791-48ed-bff5-534cd6b3e1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.141119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577903d-2791-48ed-bff5-534cd6b3e1c4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.146636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1022/2031] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:39 2022] DELETE /identity/v3/users/754166c3ca9c4b4185c2f8a087957478 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:40.148405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.156226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:40.251170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eec98-62b2-4e28-8c51-8ca5a7bcd1c9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.257345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1010/2032] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:40 2022] POST /identity/v3/projects => generated 374 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:40.257345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc15f-4e88-402d-bc1b-ec81241a4546 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.257345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc15f-4e88-402d-bc1b-ec81241a4546 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.257345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc15f-4e88-402d-bc1b-ec81241a4546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.293895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e06fc15f-4e88-402d-bc1b-ec81241a4546 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:40.295347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e06fc15f-4e88-402d-bc1b-ec81241a4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:40.331186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cb452-948d-4be2-9389-f8ff799df4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.332482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cb452-948d-4be2-9389-f8ff799df4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.332772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cb452-948d-4be2-9389-f8ff799df4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.333061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cb452-948d-4be2-9389-f8ff799df4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.334030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cb452-948d-4be2-9389-f8ff799df4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.336602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cb452-948d-4be2-9389-f8ff799df4b5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.413656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1011/2033] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:40.415609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fc15f-4e88-402d-bc1b-ec81241a4546 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.427717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1023/2034] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:40 2022] POST /identity/v3/users => generated 295 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:40.431274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cb452-948d-4be2-9389-f8ff799df4b5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.443049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cb452-948d-4be2-9389-f8ff799df4b5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.443827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fc15f-4e88-402d-bc1b-ec81241a4546 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.451699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9a6f-9cb6-48c4-9f11-5e736b38c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.452510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9a6f-9cb6-48c4-9f11-5e736b38c40c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.452654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.452904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9a6f-9cb6-48c4-9f11-5e736b38c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.453379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9a6f-9cb6-48c4-9f11-5e736b38c40c admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.453573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.453933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.454784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a9a6f-9cb6-48c4-9f11-5e736b38c40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.454905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.455122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.457267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a9a6f-9cb6-48c4-9f11-5e736b38c40c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.457629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.471715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1024/2035] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:40 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:40.472719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.477143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:40.629697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1012/2036] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:40 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:40.629697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9a6f-9cb6-48c4-9f11-5e736b38c40c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.633640 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02fd8c-6ce1-45bf-97f6-f6457378cc72 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.642487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8115fad-c02b-4bad-9a7f-1b60c8a93d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.643461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8115fad-c02b-4bad-9a7f-1b60c8a93d57 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.643751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8115fad-c02b-4bad-9a7f-1b60c8a93d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.644024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8115fad-c02b-4bad-9a7f-1b60c8a93d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.664755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8115fad-c02b-4bad-9a7f-1b60c8a93d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.666219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8115fad-c02b-4bad-9a7f-1b60c8a93d57 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.671441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9a6f-9cb6-48c4-9f11-5e736b38c40c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.676399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0911715-9695-4409-946a-add72db83384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.677603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0911715-9695-4409-946a-add72db83384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.677893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0911715-9695-4409-946a-add72db83384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.678170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0911715-9695-4409-946a-add72db83384 admin admin] PATH_INFO: `/v3/projects/7eff72eba0484b18aaefa2c81fe299de/users/b447cbc74d224341a0d53bc126c195ed/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.694862 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1025/2037] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:40.698125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8115fad-c02b-4bad-9a7f-1b60c8a93d57 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.706181 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0911715-9695-4409-946a-add72db83384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eff72eba0484b18aaefa2c81fe299de, user_id=b447cbc74d224341a0d53bc126c195ed, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.717209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0911715-9695-4409-946a-add72db83384 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.724804 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8115fad-c02b-4bad-9a7f-1b60c8a93d57 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.739962 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f93f1-fe3e-458f-8b46-196631af69e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.743474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f93f1-fe3e-458f-8b46-196631af69e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.743474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f93f1-fe3e-458f-8b46-196631af69e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.743474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f93f1-fe3e-458f-8b46-196631af69e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.743474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f93f1-fe3e-458f-8b46-196631af69e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.744276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f93f1-fe3e-458f-8b46-196631af69e0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.770400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1026/2038] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:40 2022] GET /identity/v3/roles => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:40.783180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f93f1-fe3e-458f-8b46-196631af69e0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.809955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f93f1-fe3e-458f-8b46-196631af69e0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.836404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c1cae-f754-495f-b2e6-0d99e071bb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.837172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1cae-f754-495f-b2e6-0d99e071bb0c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.837518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1cae-f754-495f-b2e6-0d99e071bb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.837906 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1cae-f754-495f-b2e6-0d99e071bb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.838748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c1cae-f754-495f-b2e6-0d99e071bb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.840460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c1cae-f754-495f-b2e6-0d99e071bb0c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.856119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1027/2039] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:40 2022] GET /identity/v3/roles => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:40.860867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c1cae-f754-495f-b2e6-0d99e071bb0c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.861037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1013/2040] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:40 2022] PUT /identity/v3/projects/7eff72eba0484b18aaefa2c81fe299de/users/b447cbc74d224341a0d53bc126c195ed/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:40.866171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0911715-9695-4409-946a-add72db83384 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:40.873415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c1cae-f754-495f-b2e6-0d99e071bb0c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:40.951940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c1fd3-6cb8-4dab-906e-90fbecebdedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:40.953301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c1fd3-6cb8-4dab-906e-90fbecebdedd admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:40.953636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c1fd3-6cb8-4dab-906e-90fbecebdedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:40.954987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c1fd3-6cb8-4dab-906e-90fbecebdedd admin admin] PATH_INFO: `/v3/projects/95ae401307104e9793e8089a41e049b1/users/52334f4c372442ba96573b1728b48dda/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:40.975482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c1fd3-6cb8-4dab-906e-90fbecebdedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ae401307104e9793e8089a41e049b1, user_id=52334f4c372442ba96573b1728b48dda, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:40.980999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c1fd3-6cb8-4dab-906e-90fbecebdedd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:40.995292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0911715-9695-4409-946a-add72db83384 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:41.000038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985462-7df0-4d9e-87fe-59db154b1949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:41.000761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985462-7df0-4d9e-87fe-59db154b1949 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:41.001043 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985462-7df0-4d9e-87fe-59db154b1949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:41.001317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985462-7df0-4d9e-87fe-59db154b1949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:41.002038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e985462-7df0-4d9e-87fe-59db154b1949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:41.003655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e985462-7df0-4d9e-87fe-59db154b1949 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:41.014578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1014/2041] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:40 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:41.018707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985462-7df0-4d9e-87fe-59db154b1949 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:41.029021 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985462-7df0-4d9e-87fe-59db154b1949 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:41.034258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d08ae-ed07-475a-8f43-742ba53520ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:41.035172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d08ae-ed07-475a-8f43-742ba53520ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:41.035456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d08ae-ed07-475a-8f43-742ba53520ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:41.035756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d08ae-ed07-475a-8f43-742ba53520ba admin admin] PATH_INFO: `/v3/projects/7eff72eba0484b18aaefa2c81fe299de/users/b447cbc74d224341a0d53bc126c195ed/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:41.039374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d08ae-ed07-475a-8f43-742ba53520ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eff72eba0484b18aaefa2c81fe299de, user_id=b447cbc74d224341a0d53bc126c195ed, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:41.042092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d08ae-ed07-475a-8f43-742ba53520ba admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:41.053544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1015/2042] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:41 2022] PUT /identity/v3/projects/7eff72eba0484b18aaefa2c81fe299de/users/b447cbc74d224341a0d53bc126c195ed/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:41.066421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d2a7b-6a1e-4df0-884a-8ea935cfed83 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:41.066940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d2a7b-6a1e-4df0-884a-8ea935cfed83 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:41.067420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d2a7b-6a1e-4df0-884a-8ea935cfed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:41.095190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1028/2043] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:40 2022] PUT /identity/v3/projects/95ae401307104e9793e8089a41e049b1/users/52334f4c372442ba96573b1728b48dda/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:41.110563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccfd5f-2a49-4282-bc3b-eae453086d9f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:41.111238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccfd5f-2a49-4282-bc3b-eae453086d9f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:41.111980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccfd5f-2a49-4282-bc3b-eae453086d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:41.145578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4eccfd5f-2a49-4282-bc3b-eae453086d9f None None] MFA Rules not processed for user `52334f4c372442ba96573b1728b48dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:41.146242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5c2d2a7b-6a1e-4df0-884a-8ea935cfed83 None None] MFA Rules not processed for user `b447cbc74d224341a0d53bc126c195ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:41.147215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4eccfd5f-2a49-4282-bc3b-eae453086d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:41.147728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5c2d2a7b-6a1e-4df0-884a-8ea935cfed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:41.162930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:41.298338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1029/2044] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:41.317586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccfd5f-2a49-4282-bc3b-eae453086d9f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:41.321264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1016/2045] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:41.322252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4eccfd5f-2a49-4282-bc3b-eae453086d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:41.343724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d2a7b-6a1e-4df0-884a-8ea935cfed83 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:41.346685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5c2d2a7b-6a1e-4df0-884a-8ea935cfed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:41.494684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccfd5f-2a49-4282-bc3b-eae453086d9f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:41.500181 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d2a7b-6a1e-4df0-884a-8ea935cfed83 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:41.500399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:41.500399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:41.500399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:41.500399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:41.502810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a70b21-418e-4928-b21e-918cc9babdd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:41.503909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70b21-418e-4928-b21e-918cc9babdd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:41.504193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70b21-418e-4928-b21e-918cc9babdd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:41.504504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70b21-418e-4928-b21e-918cc9babdd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:41.506500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c9a70b21-418e-4928-b21e-918cc9babdd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:41.511381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:41.512999 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:41.528348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1030/2046] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:41.529291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:41.530715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:41.595037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a70b21-418e-4928-b21e-918cc9babdd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:41.596846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a70b21-418e-4928-b21e-918cc9babdd9 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:41.612424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1017/2047] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:41.718984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462720eb-0fc9-4f2e-a0e3-a48975c3aa57 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:41.745206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:41.747477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:41.747832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:41.748205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] PATH_INFO: `/v3/projects/6a8e7b49b6ee491eb536614555e6758f` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:41.753372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8e7b49b6ee491eb536614555e6758f)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:41.758142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:41.852007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab34e-e0bd-4fa1-a8cc-d50989152653 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:41.852316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab34e-e0bd-4fa1-a8cc-d50989152653 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:41.852603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ab34e-e0bd-4fa1-a8cc-d50989152653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:41.873708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-669ab34e-e0bd-4fa1-a8cc-d50989152653 None None] MFA Rules not processed for user `8c1be8ccf2f14e55a5f22d4c944c6c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:41.874928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-669ab34e-e0bd-4fa1-a8cc-d50989152653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:41.954628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8e7b49b6ee491eb536614555e6758f', 'request_id': 'req-bd56fa16-1840-4291-9ed5-c83d1a057bbb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:41.964808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1018/2048] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:42.067728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8e7b49b6ee491eb536614555e6758f', 'request_id': 'req-bd56fa16-1840-4291-9ed5-c83d1a057bbb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.076459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8e7b49b6ee491eb536614555e6758f', 'request_id': 'req-bd56fa16-1840-4291-9ed5-c83d1a057bbb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.089114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] The token cache is being invalidate because project 6a8e7b49b6ee491eb536614555e6758f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:42.089402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.090246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.091973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1031/2049] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:41 2022] DELETE /identity/v3/projects/6a8e7b49b6ee491eb536614555e6758f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:42.096220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab34e-e0bd-4fa1-a8cc-d50989152653 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:42.108935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ab34e-e0bd-4fa1-a8cc-d50989152653 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:42.184073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:42.184827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:42.185208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:42.185606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] PATH_INFO: `/v3/users/bd15a65906ff49aaa47a0677876d41f4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:42.188513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd15a65906ff49aaa47a0677876d41f4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:42.190953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:42.291861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:42.394404 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd15a65906ff49aaa47a0677876d41f4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.395351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd15a65906ff49aaa47a0677876d41f4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.396628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd15a65906ff49aaa47a0677876d41f4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.420014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd15a65906ff49aaa47a0677876d41f4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.445955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd15a65906ff49aaa47a0677876d41f4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:42.534327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1019/2050] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:42 2022] DELETE /identity/v3/users/bd15a65906ff49aaa47a0677876d41f4 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:42.591814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:42.594238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:42.623946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:42.680127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56fa16-1840-4291-9ed5-c83d1a057bbb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:42.765133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b995c-51fb-4f13-b9f7-5eeba7e49584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:42.765796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b995c-51fb-4f13-b9f7-5eeba7e49584 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:42.766081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b995c-51fb-4f13-b9f7-5eeba7e49584 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:42.766357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b995c-51fb-4f13-b9f7-5eeba7e49584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:42.771357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f13b995c-51fb-4f13-b9f7-5eeba7e49584 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:42.875410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b995c-51fb-4f13-b9f7-5eeba7e49584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:42.877067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b995c-51fb-4f13-b9f7-5eeba7e49584 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:42.893794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1032/2051] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:43.397565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:43.399703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:43.492158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9795fec-e402-4bc2-a6b7-7cfe90b93a11 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:43.497640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:43.498517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.498800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.499080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] PATH_INFO: `/v3/projects/0be1c437a3e24860bbe6ef5641ac0aa4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.500280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be1c437a3e24860bbe6ef5641ac0aa4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:43.502328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:43.636785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be1c437a3e24860bbe6ef5641ac0aa4', 'request_id': 'req-625cbe2a-a368-4e54-bc63-06d0a4a53351'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:43.733301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be1c437a3e24860bbe6ef5641ac0aa4', 'request_id': 'req-625cbe2a-a368-4e54-bc63-06d0a4a53351'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:43.740838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be1c437a3e24860bbe6ef5641ac0aa4', 'request_id': 'req-625cbe2a-a368-4e54-bc63-06d0a4a53351'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:43.752664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] The token cache is being invalidate because project 0be1c437a3e24860bbe6ef5641ac0aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:43.752954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:43.753600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-625cbe2a-a368-4e54-bc63-06d0a4a53351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:43.755145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1020/2052] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:43 2022] DELETE /identity/v3/projects/0be1c437a3e24860bbe6ef5641ac0aa4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:43.760814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6164ee-8b2b-4da7-b618-90d925f6fccf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.761244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6164ee-8b2b-4da7-b618-90d925f6fccf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.761539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6164ee-8b2b-4da7-b618-90d925f6fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.779872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6a6164ee-8b2b-4da7-b618-90d925f6fccf None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:43.781170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6a6164ee-8b2b-4da7-b618-90d925f6fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:43.861977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1033/2053] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:43.870590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384732-b865-418a-beeb-cef3b763bfd0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.870879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384732-b865-418a-beeb-cef3b763bfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.871166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384732-b865-418a-beeb-cef3b763bfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.891714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3b384732-b865-418a-beeb-cef3b763bfd0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:43.892964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3b384732-b865-418a-beeb-cef3b763bfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:43.912253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1021/2054] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:43.913531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6164ee-8b2b-4da7-b618-90d925f6fccf None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:43.924053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6164ee-8b2b-4da7-b618-90d925f6fccf None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:43.928774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:43.930572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.930572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.930865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.931621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:43.931929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:43.933566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:43.946238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1034/2055] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:43.948747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:43.956454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b384732-b865-418a-beeb-cef3b763bfd0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:43.966554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b384732-b865-418a-beeb-cef3b763bfd0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:43.971161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a4fa4-631e-423f-930d-06cea3582c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:43.971879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4fa4-631e-423f-930d-06cea3582c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.972347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4fa4-631e-423f-930d-06cea3582c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.972759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a4fa4-631e-423f-930d-06cea3582c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.973588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a4fa4-631e-423f-930d-06cea3582c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:43.976705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a4fa4-631e-423f-930d-06cea3582c9f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:44.059051 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:44.060846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:44.121820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2857e9-8723-4fff-9897-88d08feea8d1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:44.126635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:44.127803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:44.127917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1022/2056] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:43 2022] POST /identity/v3/projects => generated 366 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:44.131471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:44.131888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:44.132393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a4fa4-631e-423f-930d-06cea3582c9f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:44.134112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:44.198079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:44.198783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a4fa4-631e-423f-930d-06cea3582c9f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:44.199704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:44.203916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4033f-de66-4346-81e3-a894e93a7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:44.204666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4033f-de66-4346-81e3-a894e93a7bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:44.204971 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4033f-de66-4346-81e3-a894e93a7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:44.205250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4033f-de66-4346-81e3-a894e93a7bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:44.205944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4033f-de66-4346-81e3-a894e93a7bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:44.208022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4033f-de66-4346-81e3-a894e93a7bc6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:44.208818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1035/2057] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:44.309325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1023/2058] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:44 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:44.310344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:44.321381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6538b-9490-49b4-aaf9-8ab11ca945d4 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:44.326303 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd0af-748f-4fa2-967c-db8fd3bc7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:44.326968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd0af-748f-4fa2-967c-db8fd3bc7005 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:44.327250 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd0af-748f-4fa2-967c-db8fd3bc7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:44.327530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd0af-748f-4fa2-967c-db8fd3bc7005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:44.328256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdd0af-748f-4fa2-967c-db8fd3bc7005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:44.329891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdd0af-748f-4fa2-967c-db8fd3bc7005 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:44.341513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1036/2059] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:44 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:44.346203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4033f-de66-4346-81e3-a894e93a7bc6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:44.347923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:44.357968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4033f-de66-4346-81e3-a894e93a7bc6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:44.362787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b4fa7-b06e-4c63-a5d3-f199dd09a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:44.363466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4fa7-b06e-4c63-a5d3-f199dd09a234 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:44.363745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4fa7-b06e-4c63-a5d3-f199dd09a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:44.364020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4fa7-b06e-4c63-a5d3-f199dd09a234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:44.364791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b4fa7-b06e-4c63-a5d3-f199dd09a234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:44.366410 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b4fa7-b06e-4c63-a5d3-f199dd09a234 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:44.381260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1024/2060] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:44 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:44.383801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd0af-748f-4fa2-967c-db8fd3bc7005 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:44.394159 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd0af-748f-4fa2-967c-db8fd3bc7005 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:44.400196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c48ca-2f50-4ff6-a718-378c7a44119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:44.401131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c48ca-2f50-4ff6-a718-378c7a44119f admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:44.401574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c48ca-2f50-4ff6-a718-378c7a44119f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:44.401854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c48ca-2f50-4ff6-a718-378c7a44119f admin admin] PATH_INFO: `/v3/projects/349183ab39cd49c7aa53841a11959eb7/users/e7718e93aed64eeeb74b4c94193ed594/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:44.420630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c48ca-2f50-4ff6-a718-378c7a44119f admin admin] RBAC: Authorizing `identity:create_grant(project_id=349183ab39cd49c7aa53841a11959eb7, user_id=e7718e93aed64eeeb74b4c94193ed594, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:44.423889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c48ca-2f50-4ff6-a718-378c7a44119f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:44.554921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1037/2061] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:44 2022] PUT /identity/v3/projects/349183ab39cd49c7aa53841a11959eb7/users/e7718e93aed64eeeb74b4c94193ed594/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:44.561482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad362-7bb5-4474-8088-eda6c3ca7074 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:44.562387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad362-7bb5-4474-8088-eda6c3ca7074 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:44.562665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad362-7bb5-4474-8088-eda6c3ca7074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:44.595804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b4fad362-7bb5-4474-8088-eda6c3ca7074 None None] MFA Rules not processed for user `e7718e93aed64eeeb74b4c94193ed594`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:44.597158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b4fad362-7bb5-4474-8088-eda6c3ca7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:44.669714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1025/2062] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:44.674582 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c48ca-2f50-4ff6-a718-378c7a44119f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:44.743969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c48ca-2f50-4ff6-a718-378c7a44119f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:44.748851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99036ed1-ba68-4c53-a5b5-a48c0e483198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:44.749614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99036ed1-ba68-4c53-a5b5-a48c0e483198 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:44.749900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99036ed1-ba68-4c53-a5b5-a48c0e483198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:44.750175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99036ed1-ba68-4c53-a5b5-a48c0e483198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:44.750895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99036ed1-ba68-4c53-a5b5-a48c0e483198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:44.752813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99036ed1-ba68-4c53-a5b5-a48c0e483198 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:44.864049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1038/2063] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:44 2022] POST /identity/v3/projects => generated 364 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:44.865377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad362-7bb5-4474-8088-eda6c3ca7074 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:44.878705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad362-7bb5-4474-8088-eda6c3ca7074 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:44.936742 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73230f-34e7-4cb3-8ea8-6aebe48eace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:44.937605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73230f-34e7-4cb3-8ea8-6aebe48eace6 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:44.938091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73230f-34e7-4cb3-8ea8-6aebe48eace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:44.938506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73230f-34e7-4cb3-8ea8-6aebe48eace6 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:44.939275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73230f-34e7-4cb3-8ea8-6aebe48eace6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:44.942461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73230f-34e7-4cb3-8ea8-6aebe48eace6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:45.066262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1026/2064] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:44 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:45.070439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99036ed1-ba68-4c53-a5b5-a48c0e483198 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:45.082335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99036ed1-ba68-4c53-a5b5-a48c0e483198 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:45.095012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb25574-b6c4-44d1-b1e4-5679e1082a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:45.095719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25574-b6c4-44d1-b1e4-5679e1082a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:45.096003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25574-b6c4-44d1-b1e4-5679e1082a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:45.096275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25574-b6c4-44d1-b1e4-5679e1082a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:45.097091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb25574-b6c4-44d1-b1e4-5679e1082a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:45.098669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb25574-b6c4-44d1-b1e4-5679e1082a15 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:45.111011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1039/2065] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:45 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:45.115480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73230f-34e7-4cb3-8ea8-6aebe48eace6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:45.125779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73230f-34e7-4cb3-8ea8-6aebe48eace6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:45.130329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a592ff-6f73-4415-9b3d-f322ed4bd363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:45.131194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a592ff-6f73-4415-9b3d-f322ed4bd363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:45.131474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a592ff-6f73-4415-9b3d-f322ed4bd363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:45.131747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a592ff-6f73-4415-9b3d-f322ed4bd363 admin admin] PATH_INFO: `/v3/projects/c4ac61b5978f49399cd24503d37c5c0d/users/5bbbb5f78d7a46c0be635eea8e09ae93/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:45.146364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a592ff-6f73-4415-9b3d-f322ed4bd363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ac61b5978f49399cd24503d37c5c0d, user_id=5bbbb5f78d7a46c0be635eea8e09ae93, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:45.149625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a592ff-6f73-4415-9b3d-f322ed4bd363 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:45.263630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1027/2066] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:45 2022] PUT /identity/v3/projects/c4ac61b5978f49399cd24503d37c5c0d/users/5bbbb5f78d7a46c0be635eea8e09ae93/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:45.267789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb25574-b6c4-44d1-b1e4-5679e1082a15 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:45.278897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb25574-b6c4-44d1-b1e4-5679e1082a15 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:45.361774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e25c2-cad5-4c8d-b10f-3dce3e64c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:45.362580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e25c2-cad5-4c8d-b10f-3dce3e64c915 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:45.364704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e25c2-cad5-4c8d-b10f-3dce3e64c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:45.364983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e25c2-cad5-4c8d-b10f-3dce3e64c915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:45.367739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e25c2-cad5-4c8d-b10f-3dce3e64c915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:45.369383 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e25c2-cad5-4c8d-b10f-3dce3e64c915 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:45.390266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a592ff-6f73-4415-9b3d-f322ed4bd363 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:45.391539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1040/2067] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:45 2022] GET /identity/v3/roles => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:45.404059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a592ff-6f73-4415-9b3d-f322ed4bd363 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:45.410645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:45.411740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:45.412087 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:45.412469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] PATH_INFO: `/v3/projects/c4ac61b5978f49399cd24503d37c5c0d/users/5bbbb5f78d7a46c0be635eea8e09ae93/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:45.415841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ac61b5978f49399cd24503d37c5c0d, user_id=5bbbb5f78d7a46c0be635eea8e09ae93, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:45.419546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:45.446024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1511-e3ea-4e4f-8ba5-544e28b08788 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:45.446319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1511-e3ea-4e4f-8ba5-544e28b08788 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:45.446604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1511-e3ea-4e4f-8ba5-544e28b08788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:45.452735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1028/2068] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:45 2022] PUT /identity/v3/projects/c4ac61b5978f49399cd24503d37c5c0d/users/5bbbb5f78d7a46c0be635eea8e09ae93/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:45.497783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-decd1511-e3ea-4e4f-8ba5-544e28b08788 None None] MFA Rules not processed for user `5bbbb5f78d7a46c0be635eea8e09ae93`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:45.499094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-decd1511-e3ea-4e4f-8ba5-544e28b08788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:45.594195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1041/2069] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:46.003349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:46.006204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:46.066605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c99c50-6de6-4885-bde9-6d1c9ac4dae1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:46.070450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bca6ce-4b3b-4830-91be-1ed386ee4335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:46.071231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca6ce-4b3b-4830-91be-1ed386ee4335 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:46.071578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca6ce-4b3b-4830-91be-1ed386ee4335 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:46.071905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca6ce-4b3b-4830-91be-1ed386ee4335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:46.081573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bca6ce-4b3b-4830-91be-1ed386ee4335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:46.083424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bca6ce-4b3b-4830-91be-1ed386ee4335 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:46.094433 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1029/2070] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:46.305471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:46.402701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd1511-e3ea-4e4f-8ba5-544e28b08788 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:46.415684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd1511-e3ea-4e4f-8ba5-544e28b08788 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:46.421400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:46.422064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:46.422348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:46.422622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:46.453289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bca6ce-4b3b-4830-91be-1ed386ee4335 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:46.470096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bca6ce-4b3b-4830-91be-1ed386ee4335 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:46.476746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:46.477478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:46.477836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:46.478243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:46.480001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:46.519875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:46.521369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:46.534655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1042/2071] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:46.537408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:46.561994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:46.564490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:46.581471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1030/2072] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:47.811830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:47.989379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:48.388231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:49.247829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:49.491192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:49.699140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:50.268874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:50.271237 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:50.377701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdeb71-302f-4a8d-ac9b-b439700df4bf service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:50.382261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:50.383128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:50.383407 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:50.383693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] PATH_INFO: `/v3/users/15ce650dc8854cc7be4936488efab0f8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:50.384902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ce650dc8854cc7be4936488efab0f8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:50.386876 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:50.453319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:50.465693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491d6d-e901-46f5-ab24-f403cc2790fd service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:50.470570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:50.471600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:50.471969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:50.472323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] PATH_INFO: `/v3/users/e7718e93aed64eeeb74b4c94193ed594` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:50.473731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7718e93aed64eeeb74b4c94193ed594)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:50.475689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:50.609079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ce650dc8854cc7be4936488efab0f8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.609734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ce650dc8854cc7be4936488efab0f8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.610339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ce650dc8854cc7be4936488efab0f8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.622273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ce650dc8854cc7be4936488efab0f8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.629200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3de22e0-27b5-4405-92d4-d18f794bc403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ce650dc8854cc7be4936488efab0f8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.704250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:50.709992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1043/2073] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:50 2022] DELETE /identity/v3/users/15ce650dc8854cc7be4936488efab0f8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:50.714757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923723-a783-449e-b551-66cad25da354 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:50.715119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923723-a783-449e-b551-66cad25da354 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:50.715454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc923723-a783-449e-b551-66cad25da354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:50.723877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7718e93aed64eeeb74b4c94193ed594'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.724563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7718e93aed64eeeb74b4c94193ed594'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.725165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7718e93aed64eeeb74b4c94193ed594'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.738830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7718e93aed64eeeb74b4c94193ed594'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.743743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cc923723-a783-449e-b551-66cad25da354 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:50.745064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cc923723-a783-449e-b551-66cad25da354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:50.746040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-78ed4fcb-7b30-4615-9e02-c9c0627f3995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7718e93aed64eeeb74b4c94193ed594'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:50.811687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1044/2074] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:50.822235 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923723-a783-449e-b551-66cad25da354 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:50.824220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cc923723-a783-449e-b551-66cad25da354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:50.847689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1031/2075] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:50 2022] DELETE /identity/v3/users/e7718e93aed64eeeb74b4c94193ed594 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:50.852593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dae4a-c064-4d61-b50b-6ace91faeb32 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:50.853008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dae4a-c064-4d61-b50b-6ace91faeb32 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:50.853390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dae4a-c064-4d61-b50b-6ace91faeb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:50.872171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fe9dae4a-c064-4d61-b50b-6ace91faeb32 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:50.873659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fe9dae4a-c064-4d61-b50b-6ace91faeb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:50.915781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc923723-a783-449e-b551-66cad25da354 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:50.956347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1032/2076] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:50.963675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dae4a-c064-4d61-b50b-6ace91faeb32 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:50.973373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fe9dae4a-c064-4d61-b50b-6ace91faeb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:50.997860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:50.997860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:50.997860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:50.998255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.009887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:51.011503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:51.024119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1045/2077] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:51.059831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dae4a-c064-4d61-b50b-6ace91faeb32 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:51.064215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:51.065196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.065585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.065985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.082060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:51.083717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:51.097808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1033/2078] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:51.537934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:51.543090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:51.553081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326a2fa-d661-4600-a44c-9da82a8dbde1 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:51.564663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:51.565532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.565816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.566096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] PATH_INFO: `/v3/projects/4e914c7dd24a425394ab306ba5a40e32` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.567469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e914c7dd24a425394ab306ba5a40e32)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:51.569446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:51.740429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:51.742031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:51.755780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e914c7dd24a425394ab306ba5a40e32', 'request_id': 'req-c854a2e0-6965-4cc6-a311-8ab88de4869f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:51.758514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9617-ccf2-4b1f-96c8-c91c7a836eeb service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:51.825112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:51.825973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.826260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.826565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] PATH_INFO: `/v3/projects/349183ab39cd49c7aa53841a11959eb7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.827801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=349183ab39cd49c7aa53841a11959eb7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:51.829794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:51.856939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e914c7dd24a425394ab306ba5a40e32', 'request_id': 'req-c854a2e0-6965-4cc6-a311-8ab88de4869f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:51.859444 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:51.865050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e914c7dd24a425394ab306ba5a40e32', 'request_id': 'req-c854a2e0-6965-4cc6-a311-8ab88de4869f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:51.876070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] The token cache is being invalidate because project 4e914c7dd24a425394ab306ba5a40e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:51.876400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:51.877033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:51.878879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1046/2079] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:51 2022] DELETE /identity/v3/projects/4e914c7dd24a425394ab306ba5a40e32 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:51.896712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:51.896712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:51.902488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854a2e0-6965-4cc6-a311-8ab88de4869f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:51.907134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:51.908005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.908285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.908579 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] PATH_INFO: `/v3/users/242f76896ad34b1f9d27e7c6e6ecec88` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.910129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242f76896ad34b1f9d27e7c6e6ecec88)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:51.912046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:52.097572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '349183ab39cd49c7aa53841a11959eb7', 'request_id': 'req-82968472-3384-469b-8ba5-f6056a56e932'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.097768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242f76896ad34b1f9d27e7c6e6ecec88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.098358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242f76896ad34b1f9d27e7c6e6ecec88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.098974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242f76896ad34b1f9d27e7c6e6ecec88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.111785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242f76896ad34b1f9d27e7c6e6ecec88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.119315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242f76896ad34b1f9d27e7c6e6ecec88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.180054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '349183ab39cd49c7aa53841a11959eb7', 'request_id': 'req-82968472-3384-469b-8ba5-f6056a56e932'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.187175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '349183ab39cd49c7aa53841a11959eb7', 'request_id': 'req-82968472-3384-469b-8ba5-f6056a56e932'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.198990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] The token cache is being invalidate because project 349183ab39cd49c7aa53841a11959eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:52.199431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.200156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.201748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1034/2080] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:51 2022] DELETE /identity/v3/projects/349183ab39cd49c7aa53841a11959eb7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:52.204827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:52.204827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:52.244708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1047/2081] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:51 2022] DELETE /identity/v3/users/242f76896ad34b1f9d27e7c6e6ecec88 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:52.245738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:52.247904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:52.322018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968472-3384-469b-8ba5-f6056a56e932 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:52.328047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:52.328978 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:52.329260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:52.329715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] PATH_INFO: `/v3/users/27ea67c46e1e43df9ca114cf5610ce56` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:52.332095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ea67c46e1e43df9ca114cf5610ce56)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:52.334398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:52.335007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b14fc2-d0bb-4397-9df5-0267f63df5d5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:52.340253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:52.341200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:52.341565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:52.341838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] PATH_INFO: `/v3/users/5bbbb5f78d7a46c0be635eea8e09ae93` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:52.343063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbbb5f78d7a46c0be635eea8e09ae93)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:52.345181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:52.355607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:52.578907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbbb5f78d7a46c0be635eea8e09ae93'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.579474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbbb5f78d7a46c0be635eea8e09ae93'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.580140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbbb5f78d7a46c0be635eea8e09ae93'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.592363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbbb5f78d7a46c0be635eea8e09ae93'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.599243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b95f4d1f-4806-485d-9f47-890154f4cb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbbb5f78d7a46c0be635eea8e09ae93'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.643313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ea67c46e1e43df9ca114cf5610ce56'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.643956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ea67c46e1e43df9ca114cf5610ce56'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.644570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ea67c46e1e43df9ca114cf5610ce56'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.656823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ea67c46e1e43df9ca114cf5610ce56'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.664612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ea67c46e1e43df9ca114cf5610ce56'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:52.728118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1048/2082] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:52 2022] DELETE /identity/v3/users/5bbbb5f78d7a46c0be635eea8e09ae93 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:52.729696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501eb21-5767-4971-aa60-f00983489dba None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:52.729986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501eb21-5767-4971-aa60-f00983489dba None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:52.730267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501eb21-5767-4971-aa60-f00983489dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:52.748218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b501eb21-5767-4971-aa60-f00983489dba None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:52.749613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b501eb21-5767-4971-aa60-f00983489dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:52.813456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1049/2083] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:52.816985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1035/2084] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:52 2022] DELETE /identity/v3/users/27ea67c46e1e43df9ca114cf5610ce56 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:52.823815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501eb21-5767-4971-aa60-f00983489dba None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:52.824894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b501eb21-5767-4971-aa60-f00983489dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:52.888860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501eb21-5767-4971-aa60-f00983489dba None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:52.942734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:52.943473 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:52.943774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:52.946003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.009706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:53.011943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:53.023957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1050/2085] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:53.266454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:53.268162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:53.292078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92c95-b3d7-4045-9899-ba5ba7114608 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:53.317036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:53.318201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.318583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.321269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] PATH_INFO: `/v3/projects/c4ac61b5978f49399cd24503d37c5c0d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.323325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ac61b5978f49399cd24503d37c5c0d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:53.326091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:53.423837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:53.428425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:53.440819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94bcd6-3f3c-4e00-bc03-50593ac92ea1 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:53.450456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:53.451620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.451902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.452263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] PATH_INFO: `/v3/projects/0dc1d74d30a642af95e30e4aaaf5ad36` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.453840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc1d74d30a642af95e30e4aaaf5ad36)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:53.472994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:53.486329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ac61b5978f49399cd24503d37c5c0d', 'request_id': 'req-4252b21d-eea0-43c3-9a18-3a7537f90fca'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.562910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:53.596248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ac61b5978f49399cd24503d37c5c0d', 'request_id': 'req-4252b21d-eea0-43c3-9a18-3a7537f90fca'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.606399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ac61b5978f49399cd24503d37c5c0d', 'request_id': 'req-4252b21d-eea0-43c3-9a18-3a7537f90fca'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.634497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc1d74d30a642af95e30e4aaaf5ad36', 'request_id': 'req-41efd26c-5b04-4f29-aa82-04e082d81681'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.637092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] The token cache is being invalidate because project c4ac61b5978f49399cd24503d37c5c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:53.637229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.638529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4252b21d-eea0-43c3-9a18-3a7537f90fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.642983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1036/2086] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:53 2022] DELETE /identity/v3/projects/c4ac61b5978f49399cd24503d37c5c0d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:53.647130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f0d7d-822c-49d3-8d21-1542b190c0fa None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.647485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f0d7d-822c-49d3-8d21-1542b190c0fa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.649610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f0d7d-822c-49d3-8d21-1542b190c0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.695961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3c9f0d7d-822c-49d3-8d21-1542b190c0fa None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:53.697214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c9f0d7d-822c-49d3-8d21-1542b190c0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:53.744844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc1d74d30a642af95e30e4aaaf5ad36', 'request_id': 'req-41efd26c-5b04-4f29-aa82-04e082d81681'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.754685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc1d74d30a642af95e30e4aaaf5ad36', 'request_id': 'req-41efd26c-5b04-4f29-aa82-04e082d81681'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.767197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] The token cache is being invalidate because project 0dc1d74d30a642af95e30e4aaaf5ad36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:53.767576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.768630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-41efd26c-5b04-4f29-aa82-04e082d81681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:53.777078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1051/2087] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:53 2022] DELETE /identity/v3/projects/0dc1d74d30a642af95e30e4aaaf5ad36 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:53.777266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1037/2088] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:53.779961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebbdae-cc52-48ad-b8a1-ac65e6d42242 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.782541 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57b7ef-5bee-46e3-a157-256ff05b99f6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.782652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebbdae-cc52-48ad-b8a1-ac65e6d42242 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.782652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebbdae-cc52-48ad-b8a1-ac65e6d42242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.782787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57b7ef-5bee-46e3-a157-256ff05b99f6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.782787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57b7ef-5bee-46e3-a157-256ff05b99f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.804648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b4ebbdae-cc52-48ad-b8a1-ac65e6d42242 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:53.805887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b4ebbdae-cc52-48ad-b8a1-ac65e6d42242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:53.813748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ae57b7ef-5bee-46e3-a157-256ff05b99f6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:53.815111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ae57b7ef-5bee-46e3-a157-256ff05b99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:53.815700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1052/2089] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:53.820285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebbdae-cc52-48ad-b8a1-ac65e6d42242 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:53.825834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1038/2090] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:53.829924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebbdae-cc52-48ad-b8a1-ac65e6d42242 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:53.833899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8518be-b953-4d2f-95a0-e4214de89733 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.834271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8518be-b953-4d2f-95a0-e4214de89733 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.834558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8518be-b953-4d2f-95a0-e4214de89733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.834844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:53.836162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.843931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.843931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.843931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:53.843931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:53.843931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:53.852112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1053/2091] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:53.857037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7c8518be-b953-4d2f-95a0-e4214de89733 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:53.858272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7c8518be-b953-4d2f-95a0-e4214de89733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:53.858383 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:53.867732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1039/2092] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:53.876499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b84f2-4643-473d-8460-826a80727d74 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:53.877403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8518be-b953-4d2f-95a0-e4214de89733 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:53.877902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:53.878557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.878838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.879111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.879794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:53.881778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:53.887393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8518be-b953-4d2f-95a0-e4214de89733 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:53.892606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:53.893334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.893679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.894129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.894878 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:53.895318 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:53.896798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:53.909588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1040/2093] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:13:53.914498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:53.924623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dec60-3b34-4452-87f6-cdd733b7a5a6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:53.929381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c413712-cba1-4acb-a8ef-b246b1019459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:53.930016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c413712-cba1-4acb-a8ef-b246b1019459 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.930301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c413712-cba1-4acb-a8ef-b246b1019459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.930580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c413712-cba1-4acb-a8ef-b246b1019459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.931325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c413712-cba1-4acb-a8ef-b246b1019459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:53.933345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c413712-cba1-4acb-a8ef-b246b1019459 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:53.996038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1054/2094] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:53 2022] POST /identity/v3/projects => generated 376 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:53.999510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.003210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:54.022408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1041/2095] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:53 2022] POST /identity/v3/projects => generated 386 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:54.024008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c413712-cba1-4acb-a8ef-b246b1019459 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.097532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c413712-cba1-4acb-a8ef-b246b1019459 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.101875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307c69-2ac2-4a89-8213-10964cbff3ed admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.102867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79983147-ef63-4c17-840b-970a5b436bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.104258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79983147-ef63-4c17-840b-970a5b436bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.104572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79983147-ef63-4c17-840b-970a5b436bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.105010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79983147-ef63-4c17-840b-970a5b436bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.105707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79983147-ef63-4c17-840b-970a5b436bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.107151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.107855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79983147-ef63-4c17-840b-970a5b436bcd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.108416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.108744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.108994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] PATH_INFO: `/v3/projects/f4bfd7b1466140b7b0f4311668585646` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.110200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4bfd7b1466140b7b0f4311668585646)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.112122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.233494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1042/2096] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:54 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:54.233494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79983147-ef63-4c17-840b-970a5b436bcd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.241306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79983147-ef63-4c17-840b-970a5b436bcd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.248722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c202c7-694d-4b06-b2b9-5533a0de000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.249466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c202c7-694d-4b06-b2b9-5533a0de000c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.249815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c202c7-694d-4b06-b2b9-5533a0de000c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.250326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c202c7-694d-4b06-b2b9-5533a0de000c admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.252744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c202c7-694d-4b06-b2b9-5533a0de000c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.256092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c202c7-694d-4b06-b2b9-5533a0de000c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.263534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4bfd7b1466140b7b0f4311668585646', 'request_id': 'req-8e984766-c288-48eb-80fd-d5841bc39299'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.362015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4bfd7b1466140b7b0f4311668585646', 'request_id': 'req-8e984766-c288-48eb-80fd-d5841bc39299'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.369198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1043/2097] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:54 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:54.369348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4bfd7b1466140b7b0f4311668585646', 'request_id': 'req-8e984766-c288-48eb-80fd-d5841bc39299'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.370035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c202c7-694d-4b06-b2b9-5533a0de000c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.381604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] The token cache is being invalidate because project f4bfd7b1466140b7b0f4311668585646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:54.381814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.383223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.383708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c202c7-694d-4b06-b2b9-5533a0de000c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.387811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1055/2098] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:53 2022] DELETE /identity/v3/projects/f4bfd7b1466140b7b0f4311668585646 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:54.387811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.387811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:54.446020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.446693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.446979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.447259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.447990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.449910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.463537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984766-c288-48eb-80fd-d5841bc39299 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.463699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1044/2099] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:54 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:54.463699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.464362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.464866 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:54.465216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.465543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.465822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.466547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.468138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.477682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91acfb9-a035-4308-85a9-b8c9fabd385c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.482468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1056/2100] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:54 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:54.482468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.482468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:54.482723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.483636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.488124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.488124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] PATH_INFO: `/v3/users/69db0f4cd2054d4db518631efab09947` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.488124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69db0f4cd2054d4db518631efab09947)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.488124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.495781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51711c-8b71-4332-bb62-2b0419d7b826 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.500464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeebfaf-f4c6-45ac-8a41-caa30d94048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.501123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeebfaf-f4c6-45ac-8a41-caa30d94048c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.501404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeebfaf-f4c6-45ac-8a41-caa30d94048c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.501677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeebfaf-f4c6-45ac-8a41-caa30d94048c admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.502389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeebfaf-f4c6-45ac-8a41-caa30d94048c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.504024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeebfaf-f4c6-45ac-8a41-caa30d94048c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.515536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1057/2101] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:54 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:54.516445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeebfaf-f4c6-45ac-8a41-caa30d94048c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.526687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeebfaf-f4c6-45ac-8a41-caa30d94048c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.531417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e273073-fee2-4322-a62e-565af00e5dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.532061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e273073-fee2-4322-a62e-565af00e5dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.532380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e273073-fee2-4322-a62e-565af00e5dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.532662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e273073-fee2-4322-a62e-565af00e5dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.533374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e273073-fee2-4322-a62e-565af00e5dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.535219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e273073-fee2-4322-a62e-565af00e5dfa admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.545258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1058/2102] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:54 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:54.546015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e273073-fee2-4322-a62e-565af00e5dfa admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.555880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e273073-fee2-4322-a62e-565af00e5dfa admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.560707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965085f-6566-466e-8e12-a5e14063978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.561548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965085f-6566-466e-8e12-a5e14063978c admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.561829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965085f-6566-466e-8e12-a5e14063978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.562107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965085f-6566-466e-8e12-a5e14063978c admin admin] PATH_INFO: `/v3/projects/8e1fb3dae4ef4b10b942302dbc40888b/users/ecff9f850e9a4ae9adc87db6d992ce9d/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.577801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965085f-6566-466e-8e12-a5e14063978c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1fb3dae4ef4b10b942302dbc40888b, user_id=ecff9f850e9a4ae9adc87db6d992ce9d, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.580534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965085f-6566-466e-8e12-a5e14063978c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.697767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1059/2103] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:54 2022] PUT /identity/v3/projects/8e1fb3dae4ef4b10b942302dbc40888b/users/ecff9f850e9a4ae9adc87db6d992ce9d/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:54.708286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965085f-6566-466e-8e12-a5e14063978c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.730048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69db0f4cd2054d4db518631efab09947'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.730872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69db0f4cd2054d4db518631efab09947'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.731577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69db0f4cd2054d4db518631efab09947'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.746175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69db0f4cd2054d4db518631efab09947'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.754495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8458a691-26d9-4608-8c8b-f7099f95b480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69db0f4cd2054d4db518631efab09947'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:54.782493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965085f-6566-466e-8e12-a5e14063978c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:54.787960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ff74a-d46f-4d07-8e10-2e61b644e6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:54.789495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff74a-d46f-4d07-8e10-2e61b644e6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.789808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff74a-d46f-4d07-8e10-2e61b644e6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.790085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff74a-d46f-4d07-8e10-2e61b644e6cf admin admin] PATH_INFO: `/v3/projects/d07cd4c8479540618f6d26c62144e320/users/7abb949b8837417db375502c31c6f45c/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.805548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ff74a-d46f-4d07-8e10-2e61b644e6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07cd4c8479540618f6d26c62144e320, user_id=7abb949b8837417db375502c31c6f45c, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:54.808285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ff74a-d46f-4d07-8e10-2e61b644e6cf admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:54.848116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1045/2104] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:54 2022] DELETE /identity/v3/users/69db0f4cd2054d4db518631efab09947 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:54.851622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8da5c-d44e-40dd-b269-f06dec51ac2e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.851622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8da5c-d44e-40dd-b269-f06dec51ac2e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.851622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8da5c-d44e-40dd-b269-f06dec51ac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:54.883689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-67d8da5c-d44e-40dd-b269-f06dec51ac2e None None] MFA Rules not processed for user `ecff9f850e9a4ae9adc87db6d992ce9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:54.884936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-67d8da5c-d44e-40dd-b269-f06dec51ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:54.956348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1046/2105] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:54.960637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8da5c-d44e-40dd-b269-f06dec51ac2e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:54.960833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1060/2106] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:54 2022] PUT /identity/v3/projects/d07cd4c8479540618f6d26c62144e320/users/7abb949b8837417db375502c31c6f45c/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:54.960962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-67d8da5c-d44e-40dd-b269-f06dec51ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:54.970756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643784a5-47db-4d67-82ec-7ad095caf62a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:54.971046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643784a5-47db-4d67-82ec-7ad095caf62a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:54.971329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643784a5-47db-4d67-82ec-7ad095caf62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.001097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-643784a5-47db-4d67-82ec-7ad095caf62a None None] MFA Rules not processed for user `7abb949b8837417db375502c31c6f45c`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:55.002415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-643784a5-47db-4d67-82ec-7ad095caf62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:55.048806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8da5c-d44e-40dd-b269-f06dec51ac2e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.093331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1061/2107] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:55.097860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643784a5-47db-4d67-82ec-7ad095caf62a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.099327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-643784a5-47db-4d67-82ec-7ad095caf62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:55.120260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac9f23-b427-41c2-b4ff-cc4def0c6987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.120967 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac9f23-b427-41c2-b4ff-cc4def0c6987 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.121251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac9f23-b427-41c2-b4ff-cc4def0c6987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.121533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac9f23-b427-41c2-b4ff-cc4def0c6987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.122220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac9f23-b427-41c2-b4ff-cc4def0c6987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.124290 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac9f23-b427-41c2-b4ff-cc4def0c6987 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.170111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643784a5-47db-4d67-82ec-7ad095caf62a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.175157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c63ad3-dde6-4248-89df-6425624dbf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.175844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63ad3-dde6-4248-89df-6425624dbf84 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.176121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63ad3-dde6-4248-89df-6425624dbf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.176426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63ad3-dde6-4248-89df-6425624dbf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.177143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c63ad3-dde6-4248-89df-6425624dbf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.179705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c63ad3-dde6-4248-89df-6425624dbf84 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.266028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1047/2108] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:54 2022] POST /identity/v3/projects => generated 378 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:55.270281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac9f23-b427-41c2-b4ff-cc4def0c6987 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.327067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1062/2109] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:55 2022] POST /identity/v3/projects => generated 384 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:55.331076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c63ad3-dde6-4248-89df-6425624dbf84 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.346153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac9f23-b427-41c2-b4ff-cc4def0c6987 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.410820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03abd70-acc4-4b1b-8e4b-77cd74ce0e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.411296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c63ad3-dde6-4248-89df-6425624dbf84 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.411644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03abd70-acc4-4b1b-8e4b-77cd74ce0e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.412046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03abd70-acc4-4b1b-8e4b-77cd74ce0e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.412394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03abd70-acc4-4b1b-8e4b-77cd74ce0e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.413145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03abd70-acc4-4b1b-8e4b-77cd74ce0e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.415942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03abd70-acc4-4b1b-8e4b-77cd74ce0e66 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.417479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.418139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.418421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.418693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.419382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.421323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.563636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1063/2110] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:55 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:55.566934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.566934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:55.567118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1048/2111] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:55 2022] POST /identity/v3/users => generated 296 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:55.568261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03abd70-acc4-4b1b-8e4b-77cd74ce0e66 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.579318 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03abd70-acc4-4b1b-8e4b-77cd74ce0e66 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.581745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b308501-d1f3-41c8-b0d6-c01e463e9add admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.584539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7e3e7-066c-4bdc-a6a1-3c104afba249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.585811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e3e7-066c-4bdc-a6a1-3c104afba249 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.586101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e3e7-066c-4bdc-a6a1-3c104afba249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.586378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e3e7-066c-4bdc-a6a1-3c104afba249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.587362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.587746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7e3e7-066c-4bdc-a6a1-3c104afba249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.589697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.595245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7e3e7-066c-4bdc-a6a1-3c104afba249 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.595523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.595523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] PATH_INFO: `/v3/projects/f60933129b9e49a8a5d32a4db76ed82d` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.595523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60933129b9e49a8a5d32a4db76ed82d)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.595523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.605634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1049/2112] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:55 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:55.605634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7e3e7-066c-4bdc-a6a1-3c104afba249 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.613717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:55.617880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7e3e7-066c-4bdc-a6a1-3c104afba249 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.623249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2fc28-4a49-4efc-879e-72d49fe678e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.628012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fc28-4a49-4efc-879e-72d49fe678e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.628012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fc28-4a49-4efc-879e-72d49fe678e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.628012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fc28-4a49-4efc-879e-72d49fe678e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.628012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2fc28-4a49-4efc-879e-72d49fe678e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.628012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2fc28-4a49-4efc-879e-72d49fe678e4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.638158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1050/2113] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:55 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:55.638980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2fc28-4a49-4efc-879e-72d49fe678e4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.648994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2fc28-4a49-4efc-879e-72d49fe678e4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.653583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b5d64-afcd-4385-acfd-7b561391336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.654225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5d64-afcd-4385-acfd-7b561391336c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.654507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5d64-afcd-4385-acfd-7b561391336c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.654782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5d64-afcd-4385-acfd-7b561391336c admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.655596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b5d64-afcd-4385-acfd-7b561391336c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.657128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b5d64-afcd-4385-acfd-7b561391336c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.668447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1051/2114] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:55 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:55.669226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b5d64-afcd-4385-acfd-7b561391336c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.678820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b5d64-afcd-4385-acfd-7b561391336c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.683643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29efade-9761-45bf-823a-d4592901c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.684531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29efade-9761-45bf-823a-d4592901c5db admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.684813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29efade-9761-45bf-823a-d4592901c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.685088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29efade-9761-45bf-823a-d4592901c5db admin admin] PATH_INFO: `/v3/projects/56fccf60520842d6b0af21929b8cb9be/users/25e087c01f24448095f5df9393f7102b/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.699734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29efade-9761-45bf-823a-d4592901c5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=56fccf60520842d6b0af21929b8cb9be, user_id=25e087c01f24448095f5df9393f7102b, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.702768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29efade-9761-45bf-823a-d4592901c5db admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.796996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1052/2115] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:55 2022] PUT /identity/v3/projects/56fccf60520842d6b0af21929b8cb9be/users/25e087c01f24448095f5df9393f7102b/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:55.797723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29efade-9761-45bf-823a-d4592901c5db admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.807144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60933129b9e49a8a5d32a4db76ed82d', 'request_id': 'req-faea0a23-4122-43a7-a80e-25e8faf21bc7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:55.860681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29efade-9761-45bf-823a-d4592901c5db admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.874078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60933129b9e49a8a5d32a4db76ed82d', 'request_id': 'req-faea0a23-4122-43a7-a80e-25e8faf21bc7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:55.882825 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60933129b9e49a8a5d32a4db76ed82d', 'request_id': 'req-faea0a23-4122-43a7-a80e-25e8faf21bc7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:55.895721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] The token cache is being invalidate because project f60933129b9e49a8a5d32a4db76ed82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:55.896109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:55.896881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:55.899261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1064/2116] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:55 2022] DELETE /identity/v3/projects/f60933129b9e49a8a5d32a4db76ed82d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:55.900230 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.901956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:55.927802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0dcd9-a6eb-4762-8f82-7977371bf6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.928723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0dcd9-a6eb-4762-8f82-7977371bf6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.929052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0dcd9-a6eb-4762-8f82-7977371bf6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.929375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0dcd9-a6eb-4762-8f82-7977371bf6c0 admin admin] PATH_INFO: `/v3/projects/557042cccb6c45d7a14b49a8f6319635/users/018bffed445e471e95ba5408713cabea/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.946933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0dcd9-a6eb-4762-8f82-7977371bf6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557042cccb6c45d7a14b49a8f6319635, user_id=018bffed445e471e95ba5408713cabea, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.949862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0dcd9-a6eb-4762-8f82-7977371bf6c0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.970508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea0a23-4122-43a7-a80e-25e8faf21bc7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:55.975311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:55.976578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:55.976863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:55.977141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:55.977897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:55.979495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:55.989599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1065/2117] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:55 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:55.990387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:55.992019 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:56.004256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35032c9-2956-4a71-b39f-f1043b22bcec admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:56.009441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:56.010252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.010532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.010808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] PATH_INFO: `/v3/users/b447cbc74d224341a0d53bc126c195ed` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.011980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b447cbc74d224341a0d53bc126c195ed)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:56.013974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:56.074258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1053/2118] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:55 2022] PUT /identity/v3/projects/557042cccb6c45d7a14b49a8f6319635/users/018bffed445e471e95ba5408713cabea/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:56.084555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0dcd9-a6eb-4762-8f82-7977371bf6c0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:56.145946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0dcd9-a6eb-4762-8f82-7977371bf6c0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:56.151266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344de3b-212f-4a31-b560-8e92f71bd0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:56.152146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344de3b-212f-4a31-b560-8e92f71bd0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.152460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344de3b-212f-4a31-b560-8e92f71bd0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.152738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344de3b-212f-4a31-b560-8e92f71bd0e1 admin admin] PATH_INFO: `/v3/projects/56fccf60520842d6b0af21929b8cb9be/users/25e087c01f24448095f5df9393f7102b/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.154719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344de3b-212f-4a31-b560-8e92f71bd0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56fccf60520842d6b0af21929b8cb9be, user_id=25e087c01f24448095f5df9393f7102b, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:56.157432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344de3b-212f-4a31-b560-8e92f71bd0e1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:56.168398 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1054/2119] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:56 2022] PUT /identity/v3/projects/56fccf60520842d6b0af21929b8cb9be/users/25e087c01f24448095f5df9393f7102b/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:56.169648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c52f-f60b-4b71-b12a-e34603b5b370 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.169935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c52f-f60b-4b71-b12a-e34603b5b370 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.170213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c52f-f60b-4b71-b12a-e34603b5b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.203272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cd07c52f-f60b-4b71-b12a-e34603b5b370 None None] MFA Rules not processed for user `018bffed445e471e95ba5408713cabea`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:56.204526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cd07c52f-f60b-4b71-b12a-e34603b5b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:56.283462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1055/2120] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:56.283462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c2e90-b65a-4134-8a3f-5bf119c1b4af None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.283462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c2e90-b65a-4134-8a3f-5bf119c1b4af None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.283462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c2e90-b65a-4134-8a3f-5bf119c1b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.314948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-503c2e90-b65a-4134-8a3f-5bf119c1b4af None None] MFA Rules not processed for user `25e087c01f24448095f5df9393f7102b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:56.316289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-503c2e90-b65a-4134-8a3f-5bf119c1b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:56.319523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b447cbc74d224341a0d53bc126c195ed'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:56.321168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b447cbc74d224341a0d53bc126c195ed'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:56.322050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b447cbc74d224341a0d53bc126c195ed'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:56.340629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b447cbc74d224341a0d53bc126c195ed'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:56.348813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b447cbc74d224341a0d53bc126c195ed'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:56.411311 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1056/2121] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:56.412714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c2e90-b65a-4134-8a3f-5bf119c1b4af None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:56.415927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-503c2e90-b65a-4134-8a3f-5bf119c1b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:56.454545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1066/2122] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:55 2022] DELETE /identity/v3/users/b447cbc74d224341a0d53bc126c195ed => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:56.456575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:56.456575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:56.492814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c2e90-b65a-4134-8a3f-5bf119c1b4af None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:56.549542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf79a6-6511-4340-95ea-8f1a5b83965c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:56.553656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:56.555358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfb384-9c71-45ed-a1ed-092ebc99cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:56.555841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.556012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb384-9c71-45ed-a1ed-092ebc99cb1c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.556245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.556366 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb384-9c71-45ed-a1ed-092ebc99cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.556658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfb384-9c71-45ed-a1ed-092ebc99cb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.556779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.557467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfb384-9c71-45ed-a1ed-092ebc99cb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:56.558725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:56.559795 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfb384-9c71-45ed-a1ed-092ebc99cb1c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:56.623755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:56.625224 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:56.637657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1067/2123] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:56.731179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1057/2124] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:56 2022] POST /identity/v3/projects => generated 384 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:56.734416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:56.747639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fd65c-fea6-4383-af5f-81f081c77db1 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:56.843532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:56.845144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.845144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.845144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.845731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:56.847836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:56.999314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1068/2125] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:56 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:57.003469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfb384-9c71-45ed-a1ed-092ebc99cb1c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:57.025815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfb384-9c71-45ed-a1ed-092ebc99cb1c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:57.041111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8294-394d-4a3e-9de9-a82e7b1f21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:57.041974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8294-394d-4a3e-9de9-a82e7b1f21ef admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.042260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8294-394d-4a3e-9de9-a82e7b1f21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.042538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8294-394d-4a3e-9de9-a82e7b1f21ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.043276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8294-394d-4a3e-9de9-a82e7b1f21ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:57.043877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:57.046068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8294-394d-4a3e-9de9-a82e7b1f21ef admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:57.047456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:57.066438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1058/2126] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:57 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:57.069337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8294-394d-4a3e-9de9-a82e7b1f21ef admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:57.081011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5483fc-0f60-4660-9d0c-407d6cad6755 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:57.081934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8294-394d-4a3e-9de9-a82e7b1f21ef admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:57.092920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:57.093975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d24e6-34b4-4a4b-bf1a-c1bf7c6fe7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:57.095375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.095375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.095559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d24e6-34b4-4a4b-bf1a-c1bf7c6fe7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.095647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] PATH_INFO: `/v3/projects/7eff72eba0484b18aaefa2c81fe299de` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.095744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d24e6-34b4-4a4b-bf1a-c1bf7c6fe7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.095744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d24e6-34b4-4a4b-bf1a-c1bf7c6fe7bf admin admin] PATH_INFO: `/v3/projects/0de8f39ee829411e842022025d72b4f7/users/eaf4b40922724830a68d29fc6d9ec319/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.097675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eff72eba0484b18aaefa2c81fe299de)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:57.100183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:57.117003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d24e6-34b4-4a4b-bf1a-c1bf7c6fe7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de8f39ee829411e842022025d72b4f7, user_id=eaf4b40922724830a68d29fc6d9ec319, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:57.119955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d24e6-34b4-4a4b-bf1a-c1bf7c6fe7bf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:57.229278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1059/2127] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:57 2022] PUT /identity/v3/projects/0de8f39ee829411e842022025d72b4f7/users/eaf4b40922724830a68d29fc6d9ec319/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:57.233209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d24e6-34b4-4a4b-bf1a-c1bf7c6fe7bf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:57.282846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eff72eba0484b18aaefa2c81fe299de', 'request_id': 'req-8feccde1-d099-4c41-a793-419385659d25'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:57.343642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d24e6-34b4-4a4b-bf1a-c1bf7c6fe7bf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:57.385956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55928-d908-410c-a37a-955fd13dafbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:57.386627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55928-d908-410c-a37a-955fd13dafbf admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.386908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55928-d908-410c-a37a-955fd13dafbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.387180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55928-d908-410c-a37a-955fd13dafbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.387916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55928-d908-410c-a37a-955fd13dafbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:57.390040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55928-d908-410c-a37a-955fd13dafbf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:57.401444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1060/2128] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:57 2022] GET /identity/v3/roles => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:13:57.409158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55928-d908-410c-a37a-955fd13dafbf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:57.416530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55928-d908-410c-a37a-955fd13dafbf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:57.421379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b5ea1-e1dc-4633-aaee-62cf5982ad8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:57.422218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5ea1-e1dc-4633-aaee-62cf5982ad8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.422495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5ea1-e1dc-4633-aaee-62cf5982ad8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.422765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5ea1-e1dc-4633-aaee-62cf5982ad8d admin admin] PATH_INFO: `/v3/projects/0de8f39ee829411e842022025d72b4f7/users/eaf4b40922724830a68d29fc6d9ec319/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.424766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b5ea1-e1dc-4633-aaee-62cf5982ad8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de8f39ee829411e842022025d72b4f7, user_id=eaf4b40922724830a68d29fc6d9ec319, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:57.427467 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b5ea1-e1dc-4633-aaee-62cf5982ad8d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:57.437526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1061/2129] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:57 2022] PUT /identity/v3/projects/0de8f39ee829411e842022025d72b4f7/users/eaf4b40922724830a68d29fc6d9ec319/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:13:57.447450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548f06-e116-4071-86db-9aff759e2633 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.463775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548f06-e116-4071-86db-9aff759e2633 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.463775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548f06-e116-4071-86db-9aff759e2633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.474602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4a548f06-e116-4071-86db-9aff759e2633 None None] MFA Rules not processed for user `eaf4b40922724830a68d29fc6d9ec319`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:57.475872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4a548f06-e116-4071-86db-9aff759e2633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:57.542816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1062/2130] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:57.554206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a548f06-e116-4071-86db-9aff759e2633 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:57.555518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4a548f06-e116-4071-86db-9aff759e2633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:57.576720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eff72eba0484b18aaefa2c81fe299de', 'request_id': 'req-8feccde1-d099-4c41-a793-419385659d25'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:57.587217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eff72eba0484b18aaefa2c81fe299de', 'request_id': 'req-8feccde1-d099-4c41-a793-419385659d25'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:57.605226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] The token cache is being invalidate because project 7eff72eba0484b18aaefa2c81fe299de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:13:57.605226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:57.605226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8feccde1-d099-4c41-a793-419385659d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:13:57.605226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1069/2131] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:13:57 2022] DELETE /identity/v3/projects/7eff72eba0484b18aaefa2c81fe299de => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:57.607111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb530-0d03-46cb-b6da-01b16cc73ece None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.607466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb530-0d03-46cb-b6da-01b16cc73ece None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.607809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb530-0d03-46cb-b6da-01b16cc73ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.619331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a548f06-e116-4071-86db-9aff759e2633 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:57.623680 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94d04d-7b83-417b-b902-39e2bd3e1565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:57.624341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94d04d-7b83-417b-b902-39e2bd3e1565 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.624620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94d04d-7b83-417b-b902-39e2bd3e1565 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.624892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94d04d-7b83-417b-b902-39e2bd3e1565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.626900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c89cb530-0d03-46cb-b6da-01b16cc73ece None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:57.627097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c94d04d-7b83-417b-b902-39e2bd3e1565 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:57.628165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c89cb530-0d03-46cb-b6da-01b16cc73ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:57.693657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94d04d-7b83-417b-b902-39e2bd3e1565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:57.695709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94d04d-7b83-417b-b902-39e2bd3e1565 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:57.706078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1063/2132] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:57.737977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1070/2133] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:57.741644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476938f-d633-4c10-a7c5-87f58eb2f6ac None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.742094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476938f-d633-4c10-a7c5-87f58eb2f6ac None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.742543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476938f-d633-4c10-a7c5-87f58eb2f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.762752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f476938f-d633-4c10-a7c5-87f58eb2f6ac None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:57.764127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f476938f-d633-4c10-a7c5-87f58eb2f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:57.774001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1064/2134] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:57.775196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:57.777167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cb530-0d03-46cb-b6da-01b16cc73ece None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:57.794005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cb530-0d03-46cb-b6da-01b16cc73ece None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:57.796975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:57.797791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.798087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.798434 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.799243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:13:57.799630 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:57.801598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:57.817833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1071/2135] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:13:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:13:57.819111 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476938f-d633-4c10-a7c5-87f58eb2f6ac None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:57.831545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476938f-d633-4c10-a7c5-87f58eb2f6ac None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:57.844922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a78c63-4f2e-4938-8713-8f9fb72da10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:57.845605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78c63-4f2e-4938-8713-8f9fb72da10b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:57.845884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78c63-4f2e-4938-8713-8f9fb72da10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:57.846157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78c63-4f2e-4938-8713-8f9fb72da10b admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:57.847014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a78c63-4f2e-4938-8713-8f9fb72da10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:57.848992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a78c63-4f2e-4938-8713-8f9fb72da10b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:58.001241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1065/2136] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:13:57 2022] POST /identity/v3/projects => generated 384 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:13:58.004040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:58.016004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbd562-9daa-4e39-833e-ceb7dc2d7856 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:58.076735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5062ec0-5ffa-4f2f-b45f-1c1d32a7bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:58.086615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5062ec0-5ffa-4f2f-b45f-1c1d32a7bd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.086615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5062ec0-5ffa-4f2f-b45f-1c1d32a7bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.086615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5062ec0-5ffa-4f2f-b45f-1c1d32a7bd57 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.086615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5062ec0-5ffa-4f2f-b45f-1c1d32a7bd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:58.086615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5062ec0-5ffa-4f2f-b45f-1c1d32a7bd57 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:58.250949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1072/2137] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:13:58 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:13:58.255240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a78c63-4f2e-4938-8713-8f9fb72da10b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:58.267804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a78c63-4f2e-4938-8713-8f9fb72da10b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:58.273826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc9fb-bad5-44a9-b40e-a48626aafd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:58.274504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc9fb-bad5-44a9-b40e-a48626aafd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.274807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc9fb-bad5-44a9-b40e-a48626aafd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.275105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc9fb-bad5-44a9-b40e-a48626aafd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.275838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc9fb-bad5-44a9-b40e-a48626aafd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:58.277545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc9fb-bad5-44a9-b40e-a48626aafd49 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:58.312457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1066/2138] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:58 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:58.319044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5062ec0-5ffa-4f2f-b45f-1c1d32a7bd57 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:58.334967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5062ec0-5ffa-4f2f-b45f-1c1d32a7bd57 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:58.344041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f773c-b85b-42c5-b4bf-6c2bed5b8f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:58.345114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f773c-b85b-42c5-b4bf-6c2bed5b8f0d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.345403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f773c-b85b-42c5-b4bf-6c2bed5b8f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.345860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f773c-b85b-42c5-b4bf-6c2bed5b8f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.346665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f773c-b85b-42c5-b4bf-6c2bed5b8f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:58.349675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f773c-b85b-42c5-b4bf-6c2bed5b8f0d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:58.381232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1073/2139] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:13:58 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:13:58.385496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc9fb-bad5-44a9-b40e-a48626aafd49 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:58.396274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc9fb-bad5-44a9-b40e-a48626aafd49 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:58.401820 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:58.402787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.403153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.403475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] PATH_INFO: `/v3/projects/9f1442b6171745a786e5120f5cd93c13/users/3313d0b8bdac4c879e3362cbd5c34886/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.451155 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1442b6171745a786e5120f5cd93c13, user_id=3313d0b8bdac4c879e3362cbd5c34886, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:58.453996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:58.676769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1067/2140] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:13:58 2022] PUT /identity/v3/projects/9f1442b6171745a786e5120f5cd93c13/users/3313d0b8bdac4c879e3362cbd5c34886/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:13:58.687040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2052b-4aea-4e60-a021-49121940724b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.687479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2052b-4aea-4e60-a021-49121940724b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.687789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2052b-4aea-4e60-a021-49121940724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.714918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cde2052b-4aea-4e60-a021-49121940724b None None] MFA Rules not processed for user `3313d0b8bdac4c879e3362cbd5c34886`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:58.716560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cde2052b-4aea-4e60-a021-49121940724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:58.786383 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1074/2141] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:13:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:58.841442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:58.841442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:58.912395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5acd-8042-4ea1-877d-64063548d093 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:58.917698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788d4b-9f89-4152-9e5e-ae17fb322a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:58.918357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788d4b-9f89-4152-9e5e-ae17fb322a18 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.918638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788d4b-9f89-4152-9e5e-ae17fb322a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.918904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788d4b-9f89-4152-9e5e-ae17fb322a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.930175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788d4b-9f89-4152-9e5e-ae17fb322a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:58.933159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788d4b-9f89-4152-9e5e-ae17fb322a18 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:58.943496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1068/2142] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:13:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:59.782379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2052b-4aea-4e60-a021-49121940724b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:59.784210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cde2052b-4aea-4e60-a021-49121940724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:59.859242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2052b-4aea-4e60-a021-49121940724b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:59.863939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:59.865076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:59.865355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:59.865928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] PATH_INFO: `/v3/users/52334f4c372442ba96573b1728b48dda` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:59.867890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52334f4c372442ba96573b1728b48dda)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:59.869893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:00.192971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52334f4c372442ba96573b1728b48dda'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:00.193613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52334f4c372442ba96573b1728b48dda'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:00.194232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52334f4c372442ba96573b1728b48dda'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:00.206018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52334f4c372442ba96573b1728b48dda'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:00.213413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52334f4c372442ba96573b1728b48dda'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:00.362166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1075/2143] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:13:59 2022] DELETE /identity/v3/users/52334f4c372442ba96573b1728b48dda => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:00.366836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb389a-2fa0-433c-9870-28cdb51c2e15 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:00.367394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb389a-2fa0-433c-9870-28cdb51c2e15 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:00.367491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb389a-2fa0-433c-9870-28cdb51c2e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:00.384427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5ecb389a-2fa0-433c-9870-28cdb51c2e15 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:00.385622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5ecb389a-2fa0-433c-9870-28cdb51c2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:00.391831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:00.444570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1069/2144] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:00.454247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:00.455634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:00.514660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316470-068a-4404-b623-7de29c3fa544 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:00.518299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:00.519076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:00.519415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:00.519691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:00.530673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:00.532161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:00.541840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1076/2145] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:00.700989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb389a-2fa0-433c-9870-28cdb51c2e15 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:00.702507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5ecb389a-2fa0-433c-9870-28cdb51c2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:00.766440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb389a-2fa0-433c-9870-28cdb51c2e15 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:00.770492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:00.771137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:00.771422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:00.771691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:00.774911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:00.845056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:00.846770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:00.857851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1070/2146] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:01.130356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:01.130356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:01.147892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a054a-4294-4be3-aa23-09ce346272ca service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:01.148137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:01.153219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:01.154076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:01.154353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:01.154624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] PATH_INFO: `/v3/projects/95ae401307104e9793e8089a41e049b1` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:01.155884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ae401307104e9793e8089a41e049b1)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:01.158020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:01.164096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97309ce-16cf-4744-a6d0-2fc36eb60850 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:01.165413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dacc00-7b0c-46e5-b968-8798e40ffb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:01.166231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dacc00-7b0c-46e5-b968-8798e40ffb9a service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:01.166517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dacc00-7b0c-46e5-b968-8798e40ffb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:01.166798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dacc00-7b0c-46e5-b968-8798e40ffb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:01.168650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-25dacc00-7b0c-46e5-b968-8798e40ffb9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:01.232677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dacc00-7b0c-46e5-b968-8798e40ffb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:01.234125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dacc00-7b0c-46e5-b968-8798e40ffb9a service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:01.243819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1071/2147] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:14:01.299185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ae401307104e9793e8089a41e049b1', 'request_id': 'req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:01.442014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ae401307104e9793e8089a41e049b1', 'request_id': 'req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:01.449055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ae401307104e9793e8089a41e049b1', 'request_id': 'req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:01.459576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] The token cache is being invalidate because project 95ae401307104e9793e8089a41e049b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:01.459863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:01.460544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c4b65a74-81a5-4d38-9aab-21ab8cd41fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:01.462120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1077/2148] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:01 2022] DELETE /identity/v3/projects/95ae401307104e9793e8089a41e049b1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:01.474213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d30c-ef88-4259-a61d-f33b5c944aca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:01.474713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d30c-ef88-4259-a61d-f33b5c944aca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:01.475186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d30c-ef88-4259-a61d-f33b5c944aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:01.512776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d616d30c-ef88-4259-a61d-f33b5c944aca None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:01.517082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d616d30c-ef88-4259-a61d-f33b5c944aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:01.576250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1072/2149] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:01.584197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7264e-7bdb-4a47-af5a-8a5312d9922a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:01.584626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7264e-7bdb-4a47-af5a-8a5312d9922a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:01.584912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7264e-7bdb-4a47-af5a-8a5312d9922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:01.604763 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-40a7264e-7bdb-4a47-af5a-8a5312d9922a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:01.605970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-40a7264e-7bdb-4a47-af5a-8a5312d9922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:01.613938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1078/2150] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:01.618301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d30c-ef88-4259-a61d-f33b5c944aca None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:01.628114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d30c-ef88-4259-a61d-f33b5c944aca None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:01.632690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:01.633326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:01.633603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:01.633899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:01.634619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:14:01.634919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:01.636545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:01.648827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1073/2151] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:14:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:14:01.654053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7264e-7bdb-4a47-af5a-8a5312d9922a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:01.663807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7264e-7bdb-4a47-af5a-8a5312d9922a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:01.669254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4b76c-a630-4cb4-8f28-cb95c1d7637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:01.670018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4b76c-a630-4cb4-8f28-cb95c1d7637d admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:01.670301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4b76c-a630-4cb4-8f28-cb95c1d7637d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:01.670561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4b76c-a630-4cb4-8f28-cb95c1d7637d admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:01.671288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4b76c-a630-4cb4-8f28-cb95c1d7637d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:01.673431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4b76c-a630-4cb4-8f28-cb95c1d7637d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:01.796093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1079/2152] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:01 2022] POST /identity/v3/projects => generated 372 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:14:01.797198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:01.807487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8948-99ac-4bc9-92e3-8df3cde64743 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:01.875550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccacb2-c168-4f12-aabd-7ba0f59594e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:01.876264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccacb2-c168-4f12-aabd-7ba0f59594e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:01.876581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccacb2-c168-4f12-aabd-7ba0f59594e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:01.876860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccacb2-c168-4f12-aabd-7ba0f59594e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:01.877565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccacb2-c168-4f12-aabd-7ba0f59594e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:01.879694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccacb2-c168-4f12-aabd-7ba0f59594e9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:02.015979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1074/2153] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:01 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:02.017212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4b76c-a630-4cb4-8f28-cb95c1d7637d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:02.033954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4b76c-a630-4cb4-8f28-cb95c1d7637d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:02.034063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d36a3-9b6d-4668-8c8a-e82932651604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:02.034654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d36a3-9b6d-4668-8c8a-e82932651604 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:02.034956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d36a3-9b6d-4668-8c8a-e82932651604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:02.035496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d36a3-9b6d-4668-8c8a-e82932651604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:02.036271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d36a3-9b6d-4668-8c8a-e82932651604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:02.037991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d36a3-9b6d-4668-8c8a-e82932651604 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:02.048777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1080/2154] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:02 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:02.052623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccacb2-c168-4f12-aabd-7ba0f59594e9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:02.063413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccacb2-c168-4f12-aabd-7ba0f59594e9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:02.068129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc126f0-59a1-49d8-b460-7659064184bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:02.068807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc126f0-59a1-49d8-b460-7659064184bf admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:02.069090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc126f0-59a1-49d8-b460-7659064184bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:02.069369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc126f0-59a1-49d8-b460-7659064184bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:02.070093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc126f0-59a1-49d8-b460-7659064184bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:02.072259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc126f0-59a1-49d8-b460-7659064184bf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:02.082230 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1075/2155] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:02 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:02.086386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d36a3-9b6d-4668-8c8a-e82932651604 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:02.096808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d36a3-9b6d-4668-8c8a-e82932651604 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:02.101315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:02.107096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:02.107096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:02.107096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] PATH_INFO: `/v3/projects/b3ca1a2021114ae198da8193a6f756f2/users/ba7117463c964e83b10e381e2f2d7726/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:02.119351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ca1a2021114ae198da8193a6f756f2, user_id=ba7117463c964e83b10e381e2f2d7726, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:02.122099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:02.251920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1081/2156] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:02 2022] PUT /identity/v3/projects/b3ca1a2021114ae198da8193a6f756f2/users/ba7117463c964e83b10e381e2f2d7726/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:02.256986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57a80-4986-40a0-84b8-9976b84cc5f5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:02.257273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57a80-4986-40a0-84b8-9976b84cc5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:02.257547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57a80-4986-40a0-84b8-9976b84cc5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:02.277603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2ed57a80-4986-40a0-84b8-9976b84cc5f5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:02.278910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2ed57a80-4986-40a0-84b8-9976b84cc5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:02.340680 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1076/2157] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:02.350228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:02.352642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:02.353978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:02.411174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cae65f-f6cc-4c45-86c6-a762c607da94 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:02.415048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a9415-3342-47bd-9e39-7496522c1a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:02.415701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a9415-3342-47bd-9e39-7496522c1a1e service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:02.415981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a9415-3342-47bd-9e39-7496522c1a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:02.416256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a9415-3342-47bd-9e39-7496522c1a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:02.425693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a9415-3342-47bd-9e39-7496522c1a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:02.427123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a9415-3342-47bd-9e39-7496522c1a1e service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:02.437064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1082/2158] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:02.565002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed57a80-4986-40a0-84b8-9976b84cc5f5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:02.566461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2ed57a80-4986-40a0-84b8-9976b84cc5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:02.579259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed57a80-4986-40a0-84b8-9976b84cc5f5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:02.584319 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:02.585219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:02.585471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:02.585746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] PATH_INFO: `/v3/users/3313d0b8bdac4c879e3362cbd5c34886` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:02.587769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3313d0b8bdac4c879e3362cbd5c34886)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:02.590048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:02.839491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3313d0b8bdac4c879e3362cbd5c34886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:02.840132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3313d0b8bdac4c879e3362cbd5c34886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:02.840785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3313d0b8bdac4c879e3362cbd5c34886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:02.852273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3313d0b8bdac4c879e3362cbd5c34886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:02.859977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3313d0b8bdac4c879e3362cbd5c34886'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:02.952828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1077/2159] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:02 2022] DELETE /identity/v3/users/3313d0b8bdac4c879e3362cbd5c34886 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:02.954536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a1db-0d7a-4282-a67b-01276ff4d6c0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:02.954941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a1db-0d7a-4282-a67b-01276ff4d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:02.955310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a1db-0d7a-4282-a67b-01276ff4d6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:02.974049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9aa8a1db-0d7a-4282-a67b-01276ff4d6c0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:02.979156 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9aa8a1db-0d7a-4282-a67b-01276ff4d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:03.061946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1083/2160] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:03.072391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:03.073852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:03.141552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3accd-f6bb-45bb-987c-4ff996bad32b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:03.145965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94aa58-90bf-41b9-b952-c0b4227eb679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:03.147025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94aa58-90bf-41b9-b952-c0b4227eb679 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:03.147545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94aa58-90bf-41b9-b952-c0b4227eb679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:03.148004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94aa58-90bf-41b9-b952-c0b4227eb679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:03.159048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94aa58-90bf-41b9-b952-c0b4227eb679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:03.161038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94aa58-90bf-41b9-b952-c0b4227eb679 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:03.173935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1078/2161] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:14:03.205121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8a1db-0d7a-4282-a67b-01276ff4d6c0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:03.208438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9aa8a1db-0d7a-4282-a67b-01276ff4d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:03.278123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8a1db-0d7a-4282-a67b-01276ff4d6c0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:03.291846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:03.292751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:03.295440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:03.299531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:03.299531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:03.385269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:03.386815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:03.397229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1084/2162] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:03.937769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf7e4-78a6-4cce-820f-4232c211aeb1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:03.938650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf7e4-78a6-4cce-820f-4232c211aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:03.938934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf7e4-78a6-4cce-820f-4232c211aeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:03.961467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:03.965037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:03.975375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0faaf7e4-78a6-4cce-820f-4232c211aeb1 None None] MFA Rules not processed for user `ba7117463c964e83b10e381e2f2d7726`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:03.977116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0faaf7e4-78a6-4cce-820f-4232c211aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:03.990767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa410-6e2e-43c5-b56a-4602927d0d93 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:03.996247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:03.998703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:03.999090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:03.999931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] PATH_INFO: `/v3/projects/9f1442b6171745a786e5120f5cd93c13` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:04.001923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1442b6171745a786e5120f5cd93c13)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:04.004135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:04.056356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1079/2163] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:04.065475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf7e4-78a6-4cce-820f-4232c211aeb1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:04.076456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf7e4-78a6-4cce-820f-4232c211aeb1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:04.080453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5362e9-40a8-4d56-8103-1907a2e620a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:04.081100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5362e9-40a8-4d56-8103-1907a2e620a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:04.081516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5362e9-40a8-4d56-8103-1907a2e620a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:04.081793 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5362e9-40a8-4d56-8103-1907a2e620a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:04.092475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5362e9-40a8-4d56-8103-1907a2e620a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:04.096947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5362e9-40a8-4d56-8103-1907a2e620a8 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:04.107260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1080/2164] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:14:04.177438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:04.199654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1442b6171745a786e5120f5cd93c13', 'request_id': 'req-0625451b-3642-4e1c-9962-0fc06b8dee07'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:04.285913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1442b6171745a786e5120f5cd93c13', 'request_id': 'req-0625451b-3642-4e1c-9962-0fc06b8dee07'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:04.294321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1442b6171745a786e5120f5cd93c13', 'request_id': 'req-0625451b-3642-4e1c-9962-0fc06b8dee07'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:04.305522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] The token cache is being invalidate because project 9f1442b6171745a786e5120f5cd93c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:04.305889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:04.306728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:04.308518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1085/2165] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:03 2022] DELETE /identity/v3/projects/9f1442b6171745a786e5120f5cd93c13 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:14:04.432619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:05.745984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:05.936531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851f93-8228-42da-8138-c0a8ae4efa10 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:05.936832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851f93-8228-42da-8138-c0a8ae4efa10 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:05.937109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851f93-8228-42da-8138-c0a8ae4efa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:05.954392 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-62851f93-8228-42da-8138-c0a8ae4efa10 None None] MFA Rules not processed for user `ba7117463c964e83b10e381e2f2d7726`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:05.955609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-62851f93-8228-42da-8138-c0a8ae4efa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:06.009376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1081/2166] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:06.085512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:08.202650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:08.537976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:08.775698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:08.777711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:08.843282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625451b-3642-4e1c-9962-0fc06b8dee07 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:08.847921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:08.848836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.849120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.849400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] PATH_INFO: `/v3/users/7abb949b8837417db375502c31c6f45c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.850588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abb949b8837417db375502c31c6f45c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:08.852557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:09.093988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abb949b8837417db375502c31c6f45c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:09.094628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abb949b8837417db375502c31c6f45c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:09.095248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abb949b8837417db375502c31c6f45c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:09.107429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abb949b8837417db375502c31c6f45c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:09.114133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abb949b8837417db375502c31c6f45c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:09.202747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1086/2167] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:08 2022] DELETE /identity/v3/users/7abb949b8837417db375502c31c6f45c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:09.207213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95010e25-1218-44d3-a551-35b6072d4aff None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:09.207684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95010e25-1218-44d3-a551-35b6072d4aff None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:09.207830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95010e25-1218-44d3-a551-35b6072d4aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:09.225602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-95010e25-1218-44d3-a551-35b6072d4aff None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:09.226788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-95010e25-1218-44d3-a551-35b6072d4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:09.305142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1082/2168] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:09.322928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:09.326015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:09.396451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940947c-deec-48ed-b6e5-ee281f17775b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:09.400324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64bf6f-f622-4542-aacc-9c2522cc352b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:09.401025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64bf6f-f622-4542-aacc-9c2522cc352b service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:09.401964 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64bf6f-f622-4542-aacc-9c2522cc352b service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:09.402586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64bf6f-f622-4542-aacc-9c2522cc352b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:09.412367 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64bf6f-f622-4542-aacc-9c2522cc352b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:09.413799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64bf6f-f622-4542-aacc-9c2522cc352b service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:09.423899 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1087/2169] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:09.973440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95010e25-1218-44d3-a551-35b6072d4aff None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:09.979321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-95010e25-1218-44d3-a551-35b6072d4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:09.991440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95010e25-1218-44d3-a551-35b6072d4aff None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:09.998431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:09.999666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:09.999666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:10.000089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] PATH_INFO: `/v3/projects/d07cd4c8479540618f6d26c62144e320` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:10.001403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07cd4c8479540618f6d26c62144e320)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:10.003735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:10.126061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07cd4c8479540618f6d26c62144e320', 'request_id': 'req-7478073c-3296-455b-9d4c-e3a1301ca193'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.208896 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:10.209500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07cd4c8479540618f6d26c62144e320', 'request_id': 'req-7478073c-3296-455b-9d4c-e3a1301ca193'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.216863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07cd4c8479540618f6d26c62144e320', 'request_id': 'req-7478073c-3296-455b-9d4c-e3a1301ca193'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.230402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] The token cache is being invalidate because project d07cd4c8479540618f6d26c62144e320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:10.230700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.231337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.232965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1083/2170] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:09 2022] DELETE /identity/v3/projects/d07cd4c8479540618f6d26c62144e320 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:10.237705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64bf6f-f622-4542-aacc-9c2522cc352b service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:10.249701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64bf6f-f622-4542-aacc-9c2522cc352b service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:10.340454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:10.342779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:10.343058 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:10.343331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] PATH_INFO: `/v3/users/018bffed445e471e95ba5408713cabea` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:10.344691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018bffed445e471e95ba5408713cabea)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:10.346694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:10.618955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018bffed445e471e95ba5408713cabea'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.619673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018bffed445e471e95ba5408713cabea'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.620828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018bffed445e471e95ba5408713cabea'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.634698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018bffed445e471e95ba5408713cabea'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.646019 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018bffed445e471e95ba5408713cabea'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:10.691700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:10.742661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1088/2171] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:10 2022] DELETE /identity/v3/users/018bffed445e471e95ba5408713cabea => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:14:11.347844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:11.349365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:11.366552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478073c-3296-455b-9d4c-e3a1301ca193 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:11.453083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:11.454086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:11.454367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:11.454644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] PATH_INFO: `/v3/projects/557042cccb6c45d7a14b49a8f6319635` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:11.455915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557042cccb6c45d7a14b49a8f6319635)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:11.457918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:11.628243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557042cccb6c45d7a14b49a8f6319635', 'request_id': 'req-63948f25-9f77-441e-873a-a651c6a89d24'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:11.710915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557042cccb6c45d7a14b49a8f6319635', 'request_id': 'req-63948f25-9f77-441e-873a-a651c6a89d24'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:11.717936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557042cccb6c45d7a14b49a8f6319635', 'request_id': 'req-63948f25-9f77-441e-873a-a651c6a89d24'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:11.728402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] The token cache is being invalidate because project 557042cccb6c45d7a14b49a8f6319635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:11.728689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:11.729850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:11.731463 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1084/2172] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:11 2022] DELETE /identity/v3/projects/557042cccb6c45d7a14b49a8f6319635 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:11.735310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:11.736828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:11.754859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c07eb-ba1e-4fc5-baf6-8c0085cf20c9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:11.822303 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:11.823555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:11.824664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:11.824992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:11.825384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] PATH_INFO: `/v3/users/eaf4b40922724830a68d29fc6d9ec319` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:11.826801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf4b40922724830a68d29fc6d9ec319)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:11.829169 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:12.091406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf4b40922724830a68d29fc6d9ec319'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:12.092074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf4b40922724830a68d29fc6d9ec319'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:12.092940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf4b40922724830a68d29fc6d9ec319'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:12.108863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf4b40922724830a68d29fc6d9ec319'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:12.115981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b7c33bf-2654-4774-b964-1d22e18d3ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf4b40922724830a68d29fc6d9ec319'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:12.198258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1089/2173] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:11 2022] DELETE /identity/v3/users/eaf4b40922724830a68d29fc6d9ec319 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:12.931178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:12.933384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:12.955928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948f25-9f77-441e-873a-a651c6a89d24 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:12.961489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:13.031844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:13.032734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.033010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.033280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] PATH_INFO: `/v3/projects/0de8f39ee829411e842022025d72b4f7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.034438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de8f39ee829411e842022025d72b4f7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:13.036739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:13.180485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de8f39ee829411e842022025d72b4f7', 'request_id': 'req-eb50e9fd-e800-4d71-9970-b54ac341184f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:13.276916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de8f39ee829411e842022025d72b4f7', 'request_id': 'req-eb50e9fd-e800-4d71-9970-b54ac341184f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:13.283924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de8f39ee829411e842022025d72b4f7', 'request_id': 'req-eb50e9fd-e800-4d71-9970-b54ac341184f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:13.295235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] The token cache is being invalidate because project 0de8f39ee829411e842022025d72b4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:13.295571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:13.296280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eb50e9fd-e800-4d71-9970-b54ac341184f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:13.298014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1085/2174] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:12 2022] DELETE /identity/v3/projects/0de8f39ee829411e842022025d72b4f7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:13.303631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd734772-50cd-45a8-86a0-6d5fd5da01e4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.304065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd734772-50cd-45a8-86a0-6d5fd5da01e4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.304917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd734772-50cd-45a8-86a0-6d5fd5da01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.326267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dd734772-50cd-45a8-86a0-6d5fd5da01e4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:13.326267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dd734772-50cd-45a8-86a0-6d5fd5da01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:13.391655 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1090/2175] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:13.400221 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba97dd-3b50-4d75-9b21-ddc203a5fb7d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.400533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba97dd-3b50-4d75-9b21-ddc203a5fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.401010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba97dd-3b50-4d75-9b21-ddc203a5fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.420401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ceba97dd-3b50-4d75-9b21-ddc203a5fb7d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:13.421743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ceba97dd-3b50-4d75-9b21-ddc203a5fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:13.432294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1086/2176] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:13.437622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd734772-50cd-45a8-86a0-6d5fd5da01e4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:13.447171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd734772-50cd-45a8-86a0-6d5fd5da01e4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:13.452085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5d6c4-8016-42a2-9e1a-157395a3bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:13.452882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d6c4-8016-42a2-9e1a-157395a3bbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.453106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d6c4-8016-42a2-9e1a-157395a3bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.453382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d6c4-8016-42a2-9e1a-157395a3bbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.454110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5d6c4-8016-42a2-9e1a-157395a3bbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:14:13.454426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5d6c4-8016-42a2-9e1a-157395a3bbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:13.456113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5d6c4-8016-42a2-9e1a-157395a3bbf4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:13.469703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1091/2177] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:14:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:14:13.473076 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba97dd-3b50-4d75-9b21-ddc203a5fb7d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:13.483372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba97dd-3b50-4d75-9b21-ddc203a5fb7d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:13.488085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ad237-40a7-46ad-9eac-cb6c36201204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:13.489649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ad237-40a7-46ad-9eac-cb6c36201204 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.489649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ad237-40a7-46ad-9eac-cb6c36201204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.489649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ad237-40a7-46ad-9eac-cb6c36201204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.489964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ad237-40a7-46ad-9eac-cb6c36201204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:13.491917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ad237-40a7-46ad-9eac-cb6c36201204 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:13.527757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210bf83-c0ac-4580-b572-508377f86053 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.528066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210bf83-c0ac-4580-b572-508377f86053 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.528357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210bf83-c0ac-4580-b572-508377f86053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.546878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9210bf83-c0ac-4580-b572-508377f86053 None None] MFA Rules not processed for user `95a7cc3020514672a7ab872cfdeabef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:13.548081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9210bf83-c0ac-4580-b572-508377f86053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:13.603814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1087/2179] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:13 2022] POST /identity/v3/projects => generated 368 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:13.607697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1092/2179] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:13.609003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ad237-40a7-46ad-9eac-cb6c36201204 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:13.623637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:13.702993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ad237-40a7-46ad-9eac-cb6c36201204 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:13.704442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0c126-350f-454a-b222-b406cce5f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:13.705125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0c126-350f-454a-b222-b406cce5f46d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.705408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0c126-350f-454a-b222-b406cce5f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.705684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0c126-350f-454a-b222-b406cce5f46d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.706603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0c126-350f-454a-b222-b406cce5f46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:13.708487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0c126-350f-454a-b222-b406cce5f46d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:13.801481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1088/2180] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:13 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:14:13.802809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210bf83-c0ac-4580-b572-508377f86053 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:13.814416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210bf83-c0ac-4580-b572-508377f86053 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:13.825336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9174c6-9564-4ae9-a60e-e6e36d337c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:13.826458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9174c6-9564-4ae9-a60e-e6e36d337c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.826905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9174c6-9564-4ae9-a60e-e6e36d337c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.828346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9174c6-9564-4ae9-a60e-e6e36d337c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.828346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9174c6-9564-4ae9-a60e-e6e36d337c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:13.830269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9174c6-9564-4ae9-a60e-e6e36d337c6d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:13.842303 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1093/2181] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:13 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:13.846228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0c126-350f-454a-b222-b406cce5f46d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:13.857581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0c126-350f-454a-b222-b406cce5f46d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:13.862529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa06a-e208-4814-906b-7840132b3219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:13.863194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa06a-e208-4814-906b-7840132b3219 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.863475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa06a-e208-4814-906b-7840132b3219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.863837 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa06a-e208-4814-906b-7840132b3219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.864542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fa06a-e208-4814-906b-7840132b3219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:13.866235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fa06a-e208-4814-906b-7840132b3219 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:13.877173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:13.884137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1089/2182] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:13 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:14:13.888489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9174c6-9564-4ae9-a60e-e6e36d337c6d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:13.906868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9174c6-9564-4ae9-a60e-e6e36d337c6d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:13.912277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:13.913709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:13.913709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:13.913983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] PATH_INFO: `/v3/projects/923cc64f912745b89b385c5417757099/users/c06318ec675c4f0db1ac530c27eb9472/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:13.932586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923cc64f912745b89b385c5417757099, user_id=c06318ec675c4f0db1ac530c27eb9472, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:13.935474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:14.010018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1094/2183] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:13 2022] PUT /identity/v3/projects/923cc64f912745b89b385c5417757099/users/c06318ec675c4f0db1ac530c27eb9472/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:14.021379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c473ec-32a5-418f-a4c6-9a61a4833b5c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:14.021904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c473ec-32a5-418f-a4c6-9a61a4833b5c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:14.021995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c473ec-32a5-418f-a4c6-9a61a4833b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:14.060041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-60c473ec-32a5-418f-a4c6-9a61a4833b5c None None] MFA Rules not processed for user `c06318ec675c4f0db1ac530c27eb9472`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:14.061306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-60c473ec-32a5-418f-a4c6-9a61a4833b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:14.136549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1090/2184] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:14.147860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:14.152450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:14.222040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c2d7-7fb4-4256-b58b-e25becefa7e4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:14.227484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42842885-c6d9-468b-80a4-0c050db44bfa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a2c87f8db748ba9264b141f059aab9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:14.228226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42842885-c6d9-468b-80a4-0c050db44bfa service glance] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:14.228543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42842885-c6d9-468b-80a4-0c050db44bfa service glance] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:14.228821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42842885-c6d9-468b-80a4-0c050db44bfa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:14.237880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42842885-c6d9-468b-80a4-0c050db44bfa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:14.239527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42842885-c6d9-468b-80a4-0c050db44bfa service glance] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:14.249497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1095/2185] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:15.607068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:16.169026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:16.922422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c473ec-32a5-418f-a4c6-9a61a4833b5c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:16.923987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-60c473ec-32a5-418f-a4c6-9a61a4833b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:17.009523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c473ec-32a5-418f-a4c6-9a61a4833b5c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:17.017047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:17.017955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:17.018420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:17.018842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] PATH_INFO: `/v3/users/ecff9f850e9a4ae9adc87db6d992ce9d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:17.020261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecff9f850e9a4ae9adc87db6d992ce9d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:17.022488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:17.257996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecff9f850e9a4ae9adc87db6d992ce9d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:17.259201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecff9f850e9a4ae9adc87db6d992ce9d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:17.259884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecff9f850e9a4ae9adc87db6d992ce9d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:17.279653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecff9f850e9a4ae9adc87db6d992ce9d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:17.288770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecff9f850e9a4ae9adc87db6d992ce9d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:17.388995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:17.429994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1091/2186] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:16 2022] DELETE /identity/v3/users/ecff9f850e9a4ae9adc87db6d992ce9d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:17.434634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9a7c-584d-49c1-b0af-59ee1979b25f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:17.435212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9a7c-584d-49c1-b0af-59ee1979b25f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:17.435212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9a7c-584d-49c1-b0af-59ee1979b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:17.465745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-03be9a7c-584d-49c1-b0af-59ee1979b25f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:17.474536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-03be9a7c-584d-49c1-b0af-59ee1979b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:17.569332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1096/2187] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:17.579185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:17.580743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:17.645902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48131f4-364b-4246-b219-9b20d3e05a03 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:17.649992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dca20-1254-4c12-8c02-87dece9c59ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:17.650785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dca20-1254-4c12-8c02-87dece9c59ef service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:17.651181 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dca20-1254-4c12-8c02-87dece9c59ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:17.652009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dca20-1254-4c12-8c02-87dece9c59ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:17.663837 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dca20-1254-4c12-8c02-87dece9c59ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:17.665642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dca20-1254-4c12-8c02-87dece9c59ef service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:17.679261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1092/2188] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:14:17.837616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:18.641771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9a7c-584d-49c1-b0af-59ee1979b25f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:18.643311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-03be9a7c-584d-49c1-b0af-59ee1979b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:18.655760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9a7c-584d-49c1-b0af-59ee1979b25f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:18.673731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:18.683283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:18.684842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:18.685133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] PATH_INFO: `/v3/projects/8e1fb3dae4ef4b10b942302dbc40888b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:18.687358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1fb3dae4ef4b10b942302dbc40888b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:18.689314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:18.818119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1fb3dae4ef4b10b942302dbc40888b', 'request_id': 'req-289a0d47-e662-4602-9552-61975007bd2a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:18.888284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1fb3dae4ef4b10b942302dbc40888b', 'request_id': 'req-289a0d47-e662-4602-9552-61975007bd2a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:18.895483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1fb3dae4ef4b10b942302dbc40888b', 'request_id': 'req-289a0d47-e662-4602-9552-61975007bd2a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:18.907066 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] The token cache is being invalidate because project 8e1fb3dae4ef4b10b942302dbc40888b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:18.907510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:18.908346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:18.910322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1097/2189] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:18 2022] DELETE /identity/v3/projects/8e1fb3dae4ef4b10b942302dbc40888b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:18.915062 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dca20-1254-4c12-8c02-87dece9c59ef service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:18.927397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dca20-1254-4c12-8c02-87dece9c59ef service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:19.013182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:19.014099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:19.014384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:19.014662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] PATH_INFO: `/v3/users/25e087c01f24448095f5df9393f7102b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:19.017298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e087c01f24448095f5df9393f7102b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:19.019377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:19.258234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e087c01f24448095f5df9393f7102b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:19.258915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e087c01f24448095f5df9393f7102b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:19.259637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e087c01f24448095f5df9393f7102b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:19.284205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e087c01f24448095f5df9393f7102b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:19.294647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cabfd6f4-755c-4395-bfc2-bc5deacf4375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e087c01f24448095f5df9393f7102b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:19.395782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1093/2190] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:18 2022] DELETE /identity/v3/users/25e087c01f24448095f5df9393f7102b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:19.799308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:20.053659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:20.055724 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:20.076890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a0d47-e662-4602-9552-61975007bd2a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:20.146721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:20.147609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:20.147949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:20.148163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] PATH_INFO: `/v3/projects/56fccf60520842d6b0af21929b8cb9be` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:20.149367 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56fccf60520842d6b0af21929b8cb9be)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:20.151270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:20.276816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56fccf60520842d6b0af21929b8cb9be', 'request_id': 'req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:20.388897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56fccf60520842d6b0af21929b8cb9be', 'request_id': 'req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:20.396188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56fccf60520842d6b0af21929b8cb9be', 'request_id': 'req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:20.421057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] The token cache is being invalidate because project 56fccf60520842d6b0af21929b8cb9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:20.421387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:20.422097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c2ff0e4b-ff66-4fd4-a7f0-0d384acff941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:20.423765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1098/2191] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:20 2022] DELETE /identity/v3/projects/56fccf60520842d6b0af21929b8cb9be => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:20.428747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481a8b2-d4e7-4576-bef1-33112c4710f9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:20.429296 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481a8b2-d4e7-4576-bef1-33112c4710f9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:20.429399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481a8b2-d4e7-4576-bef1-33112c4710f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:20.476702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d481a8b2-d4e7-4576-bef1-33112c4710f9 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:20.479281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d481a8b2-d4e7-4576-bef1-33112c4710f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:20.527691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:20.550028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1094/2192] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:20.560213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e36e-8a27-40fd-9d37-c47183f5a7cd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:20.560694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e36e-8a27-40fd-9d37-c47183f5a7cd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:20.561163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e36e-8a27-40fd-9d37-c47183f5a7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:20.589916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b697e36e-8a27-40fd-9d37-c47183f5a7cd None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:20.591234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b697e36e-8a27-40fd-9d37-c47183f5a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:20.600501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1099/2193] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:20.605327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481a8b2-d4e7-4576-bef1-33112c4710f9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:20.620654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481a8b2-d4e7-4576-bef1-33112c4710f9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:20.621192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:20.621852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:20.622317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:20.622594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:20.623334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:14:20.623643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:20.625308 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:20.638158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1095/2194] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:14:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:14:20.642479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697e36e-8a27-40fd-9d37-c47183f5a7cd None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:20.654848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697e36e-8a27-40fd-9d37-c47183f5a7cd None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:20.657195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4bcce-b7bc-4f81-b722-a5462793e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:20.657845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4bcce-b7bc-4f81-b722-a5462793e29d admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:20.658121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4bcce-b7bc-4f81-b722-a5462793e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:20.658393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4bcce-b7bc-4f81-b722-a5462793e29d admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:20.659088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4bcce-b7bc-4f81-b722-a5462793e29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:20.661276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4bcce-b7bc-4f81-b722-a5462793e29d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:20.762206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1100/2195] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:20 2022] POST /identity/v3/projects => generated 368 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:20.766396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:20.776612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91498f-dcb7-4cc2-9137-6bdf0d433ed4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:20.836765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2926f-0c4f-4d9c-b2f6-dc72d6e51122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:20.837346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2926f-0c4f-4d9c-b2f6-dc72d6e51122 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:20.837626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2926f-0c4f-4d9c-b2f6-dc72d6e51122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:20.837922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2926f-0c4f-4d9c-b2f6-dc72d6e51122 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:20.838630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2926f-0c4f-4d9c-b2f6-dc72d6e51122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:20.842818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2926f-0c4f-4d9c-b2f6-dc72d6e51122 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:20.956845 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1096/2196] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:20 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:14:20.957528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4bcce-b7bc-4f81-b722-a5462793e29d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:20.966193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4bcce-b7bc-4f81-b722-a5462793e29d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:20.971786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372b3d9-abe7-43e2-9084-daa8c63c836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:20.972485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b3d9-abe7-43e2-9084-daa8c63c836b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:20.972772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b3d9-abe7-43e2-9084-daa8c63c836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:20.973028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b3d9-abe7-43e2-9084-daa8c63c836b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:20.973750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372b3d9-abe7-43e2-9084-daa8c63c836b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:20.975477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372b3d9-abe7-43e2-9084-daa8c63c836b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:20.988908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1101/2197] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:20 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:20.992842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2926f-0c4f-4d9c-b2f6-dc72d6e51122 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:21.007450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2926f-0c4f-4d9c-b2f6-dc72d6e51122 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:21.013360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79d73-f413-4c82-b96b-df078dec0e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:21.014153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79d73-f413-4c82-b96b-df078dec0e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:21.014500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79d73-f413-4c82-b96b-df078dec0e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:21.014866 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79d73-f413-4c82-b96b-df078dec0e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:21.015715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b79d73-f413-4c82-b96b-df078dec0e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:21.017514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b79d73-f413-4c82-b96b-df078dec0e8b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:21.029948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1097/2198] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:20 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:21.034117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372b3d9-abe7-43e2-9084-daa8c63c836b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:21.046459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372b3d9-abe7-43e2-9084-daa8c63c836b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:21.051908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb4dc2-6fd9-4368-84fb-9768fb8f8705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:21.052915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb4dc2-6fd9-4368-84fb-9768fb8f8705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:21.053269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb4dc2-6fd9-4368-84fb-9768fb8f8705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:21.053615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb4dc2-6fd9-4368-84fb-9768fb8f8705 admin admin] PATH_INFO: `/v3/projects/f4fdb99933364da0bde96302a8a4e3f4/users/6675936fb9644da4a8ba749903d3cae7/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:21.076113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb4dc2-6fd9-4368-84fb-9768fb8f8705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fdb99933364da0bde96302a8a4e3f4, user_id=6675936fb9644da4a8ba749903d3cae7, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:21.078917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb4dc2-6fd9-4368-84fb-9768fb8f8705 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:21.233775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1102/2199] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:21 2022] PUT /identity/v3/projects/f4fdb99933364da0bde96302a8a4e3f4/users/6675936fb9644da4a8ba749903d3cae7/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:21.278520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533b81-24ef-452b-a64d-39aa6b20a3b0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:21.278520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533b81-24ef-452b-a64d-39aa6b20a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:21.278520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533b81-24ef-452b-a64d-39aa6b20a3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:21.278520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-52533b81-24ef-452b-a64d-39aa6b20a3b0 None None] MFA Rules not processed for user `6675936fb9644da4a8ba749903d3cae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:21.278520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-52533b81-24ef-452b-a64d-39aa6b20a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:21.348791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1098/2200] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:21.353729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb4dc2-6fd9-4368-84fb-9768fb8f8705 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:21.419107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb4dc2-6fd9-4368-84fb-9768fb8f8705 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:21.424754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfe89-4100-4c20-ba17-a01493c0366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:21.424754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfe89-4100-4c20-ba17-a01493c0366e admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:21.424754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfe89-4100-4c20-ba17-a01493c0366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:21.425085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfe89-4100-4c20-ba17-a01493c0366e admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:21.425658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfe89-4100-4c20-ba17-a01493c0366e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:21.427557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfe89-4100-4c20-ba17-a01493c0366e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:21.558930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1103/2201] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:21 2022] POST /identity/v3/projects => generated 368 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:14:21.562936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52533b81-24ef-452b-a64d-39aa6b20a3b0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:21.574937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52533b81-24ef-452b-a64d-39aa6b20a3b0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:21.652101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f89d6c-87d7-45ab-b95d-1e5b9f01c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:21.652821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f89d6c-87d7-45ab-b95d-1e5b9f01c6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:21.653099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f89d6c-87d7-45ab-b95d-1e5b9f01c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:21.653363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f89d6c-87d7-45ab-b95d-1e5b9f01c6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:21.654059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f89d6c-87d7-45ab-b95d-1e5b9f01c6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:21.655984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f89d6c-87d7-45ab-b95d-1e5b9f01c6d9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:21.736336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1099/2202] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:21 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:21.739691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfe89-4100-4c20-ba17-a01493c0366e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:21.750386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfe89-4100-4c20-ba17-a01493c0366e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:21.755314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f90f9-c65e-4ec9-943c-4bc7ea887f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:21.755981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f90f9-c65e-4ec9-943c-4bc7ea887f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:21.756259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f90f9-c65e-4ec9-943c-4bc7ea887f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:21.756570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f90f9-c65e-4ec9-943c-4bc7ea887f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:21.757288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f90f9-c65e-4ec9-943c-4bc7ea887f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:21.758979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f90f9-c65e-4ec9-943c-4bc7ea887f6c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:21.779311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1104/2203] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:21 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:21.782298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f89d6c-87d7-45ab-b95d-1e5b9f01c6d9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:21.793146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f89d6c-87d7-45ab-b95d-1e5b9f01c6d9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:21.797852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379d903-3060-40c9-afd8-28dd0b404258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:21.798752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379d903-3060-40c9-afd8-28dd0b404258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:21.799030 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379d903-3060-40c9-afd8-28dd0b404258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:21.799298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379d903-3060-40c9-afd8-28dd0b404258 admin admin] PATH_INFO: `/v3/projects/c455149233644a4b85dc8a559bdfd904/users/a342fb5e277c4e0a92f057104795bb14/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:21.814661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379d903-3060-40c9-afd8-28dd0b404258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c455149233644a4b85dc8a559bdfd904, user_id=a342fb5e277c4e0a92f057104795bb14, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:21.817432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379d903-3060-40c9-afd8-28dd0b404258 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:22.029105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1100/2204] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:21 2022] PUT /identity/v3/projects/c455149233644a4b85dc8a559bdfd904/users/a342fb5e277c4e0a92f057104795bb14/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:22.036817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f90f9-c65e-4ec9-943c-4bc7ea887f6c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:22.043642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f90f9-c65e-4ec9-943c-4bc7ea887f6c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:22.105311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4ec85-ca03-4051-bf4b-5b1c88779534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:22.105990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ec85-ca03-4051-bf4b-5b1c88779534 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:22.106276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ec85-ca03-4051-bf4b-5b1c88779534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:22.106556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4ec85-ca03-4051-bf4b-5b1c88779534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:22.107286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ec85-ca03-4051-bf4b-5b1c88779534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:22.109037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4ec85-ca03-4051-bf4b-5b1c88779534 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:22.119270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1105/2205] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:22 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:22.124109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379d903-3060-40c9-afd8-28dd0b404258 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:22.134821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379d903-3060-40c9-afd8-28dd0b404258 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:22.140114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:22.141112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:22.141388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:22.141663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] PATH_INFO: `/v3/projects/c455149233644a4b85dc8a559bdfd904/users/a342fb5e277c4e0a92f057104795bb14/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:22.143855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c455149233644a4b85dc8a559bdfd904, user_id=a342fb5e277c4e0a92f057104795bb14, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:22.146614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:22.159120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1101/2206] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:22 2022] PUT /identity/v3/projects/c455149233644a4b85dc8a559bdfd904/users/a342fb5e277c4e0a92f057104795bb14/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:22.172914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63d1c-07e6-44eb-9794-7f418ed1521b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:22.173208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63d1c-07e6-44eb-9794-7f418ed1521b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:22.173489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63d1c-07e6-44eb-9794-7f418ed1521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:22.212479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0fc63d1c-07e6-44eb-9794-7f418ed1521b None None] MFA Rules not processed for user `a342fb5e277c4e0a92f057104795bb14`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:22.217844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0fc63d1c-07e6-44eb-9794-7f418ed1521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:22.290135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1106/2207] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:22.304598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:22.306270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:22.399265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1d09a-564b-4258-aac4-af7f2ffb8938 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:22.403651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100447-806c-4ee6-9a23-3bf9e25e16e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:22.404447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100447-806c-4ee6-9a23-3bf9e25e16e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:22.404731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100447-806c-4ee6-9a23-3bf9e25e16e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:22.405005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100447-806c-4ee6-9a23-3bf9e25e16e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:22.415531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12100447-806c-4ee6-9a23-3bf9e25e16e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:22.417669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12100447-806c-4ee6-9a23-3bf9e25e16e6 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:22.429572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1102/2208] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:22.788160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63d1c-07e6-44eb-9794-7f418ed1521b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:22.790258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0fc63d1c-07e6-44eb-9794-7f418ed1521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:22.808806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63d1c-07e6-44eb-9794-7f418ed1521b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:22.815053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ef66e-735c-4545-8b03-e39cfed4b5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:22.815707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef66e-735c-4545-8b03-e39cfed4b5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:22.815993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef66e-735c-4545-8b03-e39cfed4b5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:22.816339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ef66e-735c-4545-8b03-e39cfed4b5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:22.875819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ef66e-735c-4545-8b03-e39cfed4b5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:22.883383 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ef66e-735c-4545-8b03-e39cfed4b5c5 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:22.887363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1107/2209] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:23.711750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:24.052163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:DELETE=12 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:24.888913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:26.523302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:26.803342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:28.391778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e813db-e4c3-4807-ae5c-3a6fc4a59fb1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:28.392289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e813db-e4c3-4807-ae5c-3a6fc4a59fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:28.392417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e813db-e4c3-4807-ae5c-3a6fc4a59fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:28.413712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-41e813db-e4c3-4807-ae5c-3a6fc4a59fb1 None None] MFA Rules not processed for user `09ad128756994ea0b6333d0694b840b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:28.414919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-41e813db-e4c3-4807-ae5c-3a6fc4a59fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:28.505857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1103/2210] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:28.655992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ef66e-735c-4545-8b03-e39cfed4b5c5 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:28.704053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:28.725541 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ef66e-735c-4545-8b03-e39cfed4b5c5 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:28.731651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:28.732698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:28.733074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:28.733412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] PATH_INFO: `/v3/users/6675936fb9644da4a8ba749903d3cae7` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:28.734918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6675936fb9644da4a8ba749903d3cae7)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:28.737453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:28.965458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6675936fb9644da4a8ba749903d3cae7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:28.966325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6675936fb9644da4a8ba749903d3cae7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:28.966956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6675936fb9644da4a8ba749903d3cae7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:28.979417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6675936fb9644da4a8ba749903d3cae7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:28.986994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6675936fb9644da4a8ba749903d3cae7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:29.084453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1108/2211] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:28 2022] DELETE /identity/v3/users/6675936fb9644da4a8ba749903d3cae7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:29.089156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00145-a3b2-4d74-b10d-dcf787c345c4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:29.092901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00145-a3b2-4d74-b10d-dcf787c345c4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:29.092901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00145-a3b2-4d74-b10d-dcf787c345c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:29.115201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-76f00145-a3b2-4d74-b10d-dcf787c345c4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:29.121814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-76f00145-a3b2-4d74-b10d-dcf787c345c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:29.152009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:29.179688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1104/2212] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:29.191041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:29.192646 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:29.260538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7478199-b36e-44c9-8576-fbb4ada959d7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:29.268030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:29.268030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:29.271026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:29.271026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:29.280346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:29.281923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:29.298675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1109/2213] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:29.544777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376eb1-8ca4-4cf2-990c-a71ca7e2b4b0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:29.544777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376eb1-8ca4-4cf2-990c-a71ca7e2b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:29.544777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376eb1-8ca4-4cf2-990c-a71ca7e2b4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:29.557908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3f376eb1-8ca4-4cf2-990c-a71ca7e2b4b0 None None] MFA Rules not processed for user `ba7117463c964e83b10e381e2f2d7726`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:29.559276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3f376eb1-8ca4-4cf2-990c-a71ca7e2b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:29.622905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1105/2214] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:30.084911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:30.086551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:30.107171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773de1-219d-4753-bd8b-6a5f596797ff service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:30.124865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:30.126134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:30.126428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:30.126708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] PATH_INFO: `/v3/projects/f4fdb99933364da0bde96302a8a4e3f4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:30.128101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fdb99933364da0bde96302a8a4e3f4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:30.130177 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:30.281398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fdb99933364da0bde96302a8a4e3f4', 'request_id': 'req-bc20c710-a37d-4d3a-b882-31cee00bac92'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.390321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fdb99933364da0bde96302a8a4e3f4', 'request_id': 'req-bc20c710-a37d-4d3a-b882-31cee00bac92'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.398524 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fdb99933364da0bde96302a8a4e3f4', 'request_id': 'req-bc20c710-a37d-4d3a-b882-31cee00bac92'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.410118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] The token cache is being invalidate because project f4fdb99933364da0bde96302a8a4e3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:30.410328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.410981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.416406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1110/2215] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:30 2022] DELETE /identity/v3/projects/f4fdb99933364da0bde96302a8a4e3f4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:30.417453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f376eb1-8ca4-4cf2-990c-a71ca7e2b4b0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:30.437513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f376eb1-8ca4-4cf2-990c-a71ca7e2b4b0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:30.515480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:30.516381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:30.517291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:30.517569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] PATH_INFO: `/v3/users/a342fb5e277c4e0a92f057104795bb14` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:30.518781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a342fb5e277c4e0a92f057104795bb14)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:30.520800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:30.529128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:30.747508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a342fb5e277c4e0a92f057104795bb14'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.748176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a342fb5e277c4e0a92f057104795bb14'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.748800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a342fb5e277c4e0a92f057104795bb14'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.760740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a342fb5e277c4e0a92f057104795bb14'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.767484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-507c525b-53b1-46ea-94e4-3e8e79ad7880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a342fb5e277c4e0a92f057104795bb14'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:30.883072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1106/2216] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:30 2022] DELETE /identity/v3/users/a342fb5e277c4e0a92f057104795bb14 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:31.175019 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:31.470486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:31.471948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:31.486116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20c710-a37d-4d3a-b882-31cee00bac92 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:31.570712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:31.571507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:31.571791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:31.572067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] PATH_INFO: `/v3/projects/c455149233644a4b85dc8a559bdfd904` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:31.573314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c455149233644a4b85dc8a559bdfd904)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:31.575452 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:31.684049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c455149233644a4b85dc8a559bdfd904', 'request_id': 'req-e99874ff-73cc-490d-96d7-04cabb69f770'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:31.768595 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c455149233644a4b85dc8a559bdfd904', 'request_id': 'req-e99874ff-73cc-490d-96d7-04cabb69f770'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:31.775443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c455149233644a4b85dc8a559bdfd904', 'request_id': 'req-e99874ff-73cc-490d-96d7-04cabb69f770'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:31.786757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] The token cache is being invalidate because project c455149233644a4b85dc8a559bdfd904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:31.789562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:31.789562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e99874ff-73cc-490d-96d7-04cabb69f770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:31.789562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1111/2217] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:31 2022] DELETE /identity/v3/projects/c455149233644a4b85dc8a559bdfd904 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:31.795141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91fc6d-e7af-474e-9053-063d7aaddbac None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:31.795630 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91fc6d-e7af-474e-9053-063d7aaddbac None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:31.795737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91fc6d-e7af-474e-9053-063d7aaddbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:31.813809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7c91fc6d-e7af-474e-9053-063d7aaddbac None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:31.818267 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7c91fc6d-e7af-474e-9053-063d7aaddbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:31.875407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1107/2218] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:31.883766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c099-38b8-4967-832f-2df31320f09e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:31.884047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c099-38b8-4967-832f-2df31320f09e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:31.884347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c099-38b8-4967-832f-2df31320f09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:31.903925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-fd19c099-38b8-4967-832f-2df31320f09e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:31.905163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fd19c099-38b8-4967-832f-2df31320f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:31.913363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1112/2219] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:31.917504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91fc6d-e7af-474e-9053-063d7aaddbac None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:31.927497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91fc6d-e7af-474e-9053-063d7aaddbac None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:31.931875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:31.932552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:31.932875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:31.933144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:31.934045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:14:31.934370 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:31.936135 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:31.947622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1108/2220] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:14:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:14:31.952510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c099-38b8-4967-832f-2df31320f09e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:31.961725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c099-38b8-4967-832f-2df31320f09e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:31.967301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14755d37-165b-4c2b-ae00-3d00faf45ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:31.967945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14755d37-165b-4c2b-ae00-3d00faf45ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:31.968227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14755d37-165b-4c2b-ae00-3d00faf45ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:31.968531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14755d37-165b-4c2b-ae00-3d00faf45ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:31.969222 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14755d37-165b-4c2b-ae00-3d00faf45ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:31.971117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14755d37-165b-4c2b-ae00-3d00faf45ab5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:32.061731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1113/2221] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:31 2022] POST /identity/v3/projects => generated 388 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:14:32.066652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:32.077699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fafb31-0746-4262-966a-9123adc76ca6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:32.137852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42671e2-0fe4-4d84-bf57-91a489c33f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:32.138534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42671e2-0fe4-4d84-bf57-91a489c33f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.138824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42671e2-0fe4-4d84-bf57-91a489c33f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.139120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42671e2-0fe4-4d84-bf57-91a489c33f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.139836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42671e2-0fe4-4d84-bf57-91a489c33f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:32.141816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42671e2-0fe4-4d84-bf57-91a489c33f22 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:32.248081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1109/2222] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:32 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:32.252072 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14755d37-165b-4c2b-ae00-3d00faf45ab5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:32.263946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14755d37-165b-4c2b-ae00-3d00faf45ab5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:32.268835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ef687-2b03-47c8-8929-2406368d71dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:32.269577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ef687-2b03-47c8-8929-2406368d71dd admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.269921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ef687-2b03-47c8-8929-2406368d71dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.270296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ef687-2b03-47c8-8929-2406368d71dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.271086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ef687-2b03-47c8-8929-2406368d71dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:32.272770 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ef687-2b03-47c8-8929-2406368d71dd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:32.288374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1114/2223] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:32 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:14:32.288973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42671e2-0fe4-4d84-bf57-91a489c33f22 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:32.299665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42671e2-0fe4-4d84-bf57-91a489c33f22 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:32.316712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8c371-e783-41e5-9421-f437affc8b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:32.316712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c371-e783-41e5-9421-f437affc8b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.316712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c371-e783-41e5-9421-f437affc8b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.316712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c371-e783-41e5-9421-f437affc8b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.317662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8c371-e783-41e5-9421-f437affc8b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:32.317662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8c371-e783-41e5-9421-f437affc8b83 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:32.319260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1110/2224] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:32 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:32.323227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ef687-2b03-47c8-8929-2406368d71dd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:32.333608 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ef687-2b03-47c8-8929-2406368d71dd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:32.338188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31daea-7d9f-400c-8f41-1f632c0ec99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:32.339057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31daea-7d9f-400c-8f41-1f632c0ec99e admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.339326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31daea-7d9f-400c-8f41-1f632c0ec99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.339615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31daea-7d9f-400c-8f41-1f632c0ec99e admin admin] PATH_INFO: `/v3/projects/016f9d1975b94069a59a5af4178751da/users/73a7eb196fa440de9709cdc57140d41c/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.354176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31daea-7d9f-400c-8f41-1f632c0ec99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=016f9d1975b94069a59a5af4178751da, user_id=73a7eb196fa440de9709cdc57140d41c, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:32.357152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31daea-7d9f-400c-8f41-1f632c0ec99e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:32.423251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:32.527571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1115/2225] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:32 2022] PUT /identity/v3/projects/016f9d1975b94069a59a5af4178751da/users/73a7eb196fa440de9709cdc57140d41c/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:14:32.538071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8f06-8078-4057-8e42-68fe600e4b5b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.538364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8f06-8078-4057-8e42-68fe600e4b5b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.538648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8f06-8078-4057-8e42-68fe600e4b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.565869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3c4a8f06-8078-4057-8e42-68fe600e4b5b None None] MFA Rules not processed for user `73a7eb196fa440de9709cdc57140d41c`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:32.567127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c4a8f06-8078-4057-8e42-68fe600e4b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:32.634981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1111/2226] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:32.640024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31daea-7d9f-400c-8f41-1f632c0ec99e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:32.723806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31daea-7d9f-400c-8f41-1f632c0ec99e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:32.728985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c5f64-6bda-4efd-b4e3-d71e035b7cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:32.729645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c5f64-6bda-4efd-b4e3-d71e035b7cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.729925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c5f64-6bda-4efd-b4e3-d71e035b7cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.730199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c5f64-6bda-4efd-b4e3-d71e035b7cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.731708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c5f64-6bda-4efd-b4e3-d71e035b7cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:32.733722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c5f64-6bda-4efd-b4e3-d71e035b7cc7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:32.769151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:32.840094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1116/2227] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:32 2022] POST /identity/v3/projects => generated 388 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:32.844556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a8f06-8078-4057-8e42-68fe600e4b5b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:32.856692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a8f06-8078-4057-8e42-68fe600e4b5b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:32.914515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f84d73-7278-4af8-9f84-e0d006abbd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:32.915098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f84d73-7278-4af8-9f84-e0d006abbd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.915381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f84d73-7278-4af8-9f84-e0d006abbd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.915659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f84d73-7278-4af8-9f84-e0d006abbd4d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.916375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f84d73-7278-4af8-9f84-e0d006abbd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:32.918958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f84d73-7278-4af8-9f84-e0d006abbd4d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:33.020888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1112/2228] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:32 2022] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:33.024689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c5f64-6bda-4efd-b4e3-d71e035b7cc7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:33.037006 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c5f64-6bda-4efd-b4e3-d71e035b7cc7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:33.041727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f447a1d-705e-43af-8cf8-bae220aa3e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:33.042394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447a1d-705e-43af-8cf8-bae220aa3e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:33.042704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447a1d-705e-43af-8cf8-bae220aa3e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:33.043780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447a1d-705e-43af-8cf8-bae220aa3e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:33.044686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f447a1d-705e-43af-8cf8-bae220aa3e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:33.046293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f447a1d-705e-43af-8cf8-bae220aa3e76 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:33.057908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1117/2229] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:33 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:33.062641 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f84d73-7278-4af8-9f84-e0d006abbd4d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:33.074132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f84d73-7278-4af8-9f84-e0d006abbd4d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:33.080923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc864-34fd-443a-a644-ad4677a095da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:33.081865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc864-34fd-443a-a644-ad4677a095da admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:33.082146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc864-34fd-443a-a644-ad4677a095da admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:33.082422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc864-34fd-443a-a644-ad4677a095da admin admin] PATH_INFO: `/v3/projects/7614d5e249434429872025324e319e9e/users/c8495860f36b4d23926960c2f1d21a2a/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:33.098920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc864-34fd-443a-a644-ad4677a095da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7614d5e249434429872025324e319e9e, user_id=c8495860f36b4d23926960c2f1d21a2a, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:33.101723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc864-34fd-443a-a644-ad4677a095da admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:33.178426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1113/2230] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:33 2022] PUT /identity/v3/projects/7614d5e249434429872025324e319e9e/users/c8495860f36b4d23926960c2f1d21a2a/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:33.185384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f447a1d-705e-43af-8cf8-bae220aa3e76 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:33.198020 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f447a1d-705e-43af-8cf8-bae220aa3e76 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:33.268094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a4971-6ebd-41be-aa61-12a4f5dc96bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:33.268852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a4971-6ebd-41be-aa61-12a4f5dc96bb admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:33.269142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a4971-6ebd-41be-aa61-12a4f5dc96bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:33.269415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a4971-6ebd-41be-aa61-12a4f5dc96bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:33.270236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a4971-6ebd-41be-aa61-12a4f5dc96bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:33.271748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a4971-6ebd-41be-aa61-12a4f5dc96bb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:33.287288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1118/2231] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:33 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:33.294603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc864-34fd-443a-a644-ad4677a095da admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:33.307402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc864-34fd-443a-a644-ad4677a095da admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:33.314918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:33.316536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:33.316823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:33.317105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] PATH_INFO: `/v3/projects/7614d5e249434429872025324e319e9e/users/c8495860f36b4d23926960c2f1d21a2a/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:33.319219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7614d5e249434429872025324e319e9e, user_id=c8495860f36b4d23926960c2f1d21a2a, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:33.322122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:33.335081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1114/2232] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:33 2022] PUT /identity/v3/projects/7614d5e249434429872025324e319e9e/users/c8495860f36b4d23926960c2f1d21a2a/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:33.346321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf561-150b-46b7-80f9-3bf88ee88e54 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:33.346699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf561-150b-46b7-80f9-3bf88ee88e54 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:33.347074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf561-150b-46b7-80f9-3bf88ee88e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:33.378886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0adbf561-150b-46b7-80f9-3bf88ee88e54 None None] MFA Rules not processed for user `c8495860f36b4d23926960c2f1d21a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:33.380353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0adbf561-150b-46b7-80f9-3bf88ee88e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:33.493685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1119/2233] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:33.507680 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:33.510586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:33.584107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea4ab-ee01-42d4-b0ca-53ee0e8134b9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:33.590331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b774fd6-5277-4869-87c5-aaabe65a5641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:33.591910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774fd6-5277-4869-87c5-aaabe65a5641 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:33.592553 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774fd6-5277-4869-87c5-aaabe65a5641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:33.594562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774fd6-5277-4869-87c5-aaabe65a5641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:33.607274 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b774fd6-5277-4869-87c5-aaabe65a5641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:33.609105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b774fd6-5277-4869-87c5-aaabe65a5641 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:33.622342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1115/2234] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:33.651682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf561-150b-46b7-80f9-3bf88ee88e54 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:33.718710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf561-150b-46b7-80f9-3bf88ee88e54 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:33.725831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:33.727378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:33.728190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:33.728589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] PATH_INFO: `/v3/users/73a7eb196fa440de9709cdc57140d41c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:33.730135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a7eb196fa440de9709cdc57140d41c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:33.742332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:33.946537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a7eb196fa440de9709cdc57140d41c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:33.947180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a7eb196fa440de9709cdc57140d41c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:33.947777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a7eb196fa440de9709cdc57140d41c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:33.979285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a7eb196fa440de9709cdc57140d41c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:33.990797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a7eb196fa440de9709cdc57140d41c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:34.015198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:34.073305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1120/2235] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:33 2022] DELETE /identity/v3/users/73a7eb196fa440de9709cdc57140d41c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:34.077974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cac66-42ed-4601-b475-d24775fa03d2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:34.078265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cac66-42ed-4601-b475-d24775fa03d2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:34.078546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cac66-42ed-4601-b475-d24775fa03d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:34.098048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-672cac66-42ed-4601-b475-d24775fa03d2 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:34.099629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-672cac66-42ed-4601-b475-d24775fa03d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:34.169847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1116/2236] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:34.223739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:34.225511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:34.306465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8e27-5217-4187-b4c1-70d69aa3f994 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:34.310664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749337-ba7e-4c78-b38e-a33f090bae55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:34.311405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749337-ba7e-4c78-b38e-a33f090bae55 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:34.311672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749337-ba7e-4c78-b38e-a33f090bae55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:34.311947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749337-ba7e-4c78-b38e-a33f090bae55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:34.328096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749337-ba7e-4c78-b38e-a33f090bae55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:34.330291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749337-ba7e-4c78-b38e-a33f090bae55 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:34.342246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1121/2237] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:35.140821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:35.810988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cac66-42ed-4601-b475-d24775fa03d2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:35.813852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-672cac66-42ed-4601-b475-d24775fa03d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:35.830289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cac66-42ed-4601-b475-d24775fa03d2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:35.859804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:35.867105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:35.881744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:35.890006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] PATH_INFO: `/v3/projects/016f9d1975b94069a59a5af4178751da` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:35.892629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=016f9d1975b94069a59a5af4178751da)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:35.897596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:36.032526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016f9d1975b94069a59a5af4178751da', 'request_id': 'req-0a577678-84d4-418b-92fb-1915f40bbe1b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.094815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:36.120404 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016f9d1975b94069a59a5af4178751da', 'request_id': 'req-0a577678-84d4-418b-92fb-1915f40bbe1b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.129468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016f9d1975b94069a59a5af4178751da', 'request_id': 'req-0a577678-84d4-418b-92fb-1915f40bbe1b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.160622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] The token cache is being invalidate because project 016f9d1975b94069a59a5af4178751da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:36.160926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.161977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0a577678-84d4-418b-92fb-1915f40bbe1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.173060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1117/2238] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:35 2022] DELETE /identity/v3/projects/016f9d1975b94069a59a5af4178751da => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:36.176273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749337-ba7e-4c78-b38e-a33f090bae55 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:36.211874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749337-ba7e-4c78-b38e-a33f090bae55 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:36.367683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:36.374013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:36.374013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:36.374013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] PATH_INFO: `/v3/users/c8495860f36b4d23926960c2f1d21a2a` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:36.374013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8495860f36b4d23926960c2f1d21a2a)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:36.378589 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:36.620077 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8495860f36b4d23926960c2f1d21a2a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.624800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8495860f36b4d23926960c2f1d21a2a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.628080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8495860f36b4d23926960c2f1d21a2a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.644980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8495860f36b4d23926960c2f1d21a2a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.657762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8495860f36b4d23926960c2f1d21a2a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:36.787038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1122/2239] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:36 2022] DELETE /identity/v3/users/c8495860f36b4d23926960c2f1d21a2a => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:37.175495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:37.576158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:37.644171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d108-356f-45f6-b809-14a8ee0f3f4e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:37.645070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d108-356f-45f6-b809-14a8ee0f3f4e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:37.650596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d108-356f-45f6-b809-14a8ee0f3f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:37.733178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0687d108-356f-45f6-b809-14a8ee0f3f4e None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:37.736853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0687d108-356f-45f6-b809-14a8ee0f3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:37.740747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:37.742393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:37.850980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1118/2240] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:14:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:37.858181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64281d-69e0-4e29-b629-53ede7425f19 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:37.878846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:37.878846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:37.878846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:37.878846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] PATH_INFO: `/v3/projects/7614d5e249434429872025324e319e9e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:37.879285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7614d5e249434429872025324e319e9e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:37.880318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:37.901771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d108-356f-45f6-b809-14a8ee0f3f4e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:37.904057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0687d108-356f-45f6-b809-14a8ee0f3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:38.003615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d108-356f-45f6-b809-14a8ee0f3f4e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:38.009423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf90e4-7284-4e7d-a6ae-b798fd298615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:38.009916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf90e4-7284-4e7d-a6ae-b798fd298615 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.010523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf90e4-7284-4e7d-a6ae-b798fd298615 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.028066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf90e4-7284-4e7d-a6ae-b798fd298615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:38.028066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf90e4-7284-4e7d-a6ae-b798fd298615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:38.028066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf90e4-7284-4e7d-a6ae-b798fd298615 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:38.028807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7614d5e249434429872025324e319e9e', 'request_id': 'req-ca395fe9-85f9-47c5-a846-c8b212480717'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:38.033685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1119/2241] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:14:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:14:38.135315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7614d5e249434429872025324e319e9e', 'request_id': 'req-ca395fe9-85f9-47c5-a846-c8b212480717'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:38.143321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7614d5e249434429872025324e319e9e', 'request_id': 'req-ca395fe9-85f9-47c5-a846-c8b212480717'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:38.160507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] The token cache is being invalidate because project 7614d5e249434429872025324e319e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:38.161139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:38.162684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ca395fe9-85f9-47c5-a846-c8b212480717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:38.164944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1123/2242] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:37 2022] DELETE /identity/v3/projects/7614d5e249434429872025324e319e9e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:14:38.172042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2ed5-1cc1-4b17-87b6-ed5bcf674d1d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.172366 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2ed5-1cc1-4b17-87b6-ed5bcf674d1d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.172656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2ed5-1cc1-4b17-87b6-ed5bcf674d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:38.196860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9b2e2ed5-1cc1-4b17-87b6-ed5bcf674d1d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:38.200168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9b2e2ed5-1cc1-4b17-87b6-ed5bcf674d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:38.273838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1120/2243] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:38.275996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95958b73-7ccc-4fff-933d-452b0bb45362 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.276387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95958b73-7ccc-4fff-933d-452b0bb45362 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.276940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95958b73-7ccc-4fff-933d-452b0bb45362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:38.303800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-95958b73-7ccc-4fff-933d-452b0bb45362 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:38.305478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-95958b73-7ccc-4fff-933d-452b0bb45362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:38.318737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1124/2244] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:38.325183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2ed5-1cc1-4b17-87b6-ed5bcf674d1d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:38.338275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2ed5-1cc1-4b17-87b6-ed5bcf674d1d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:38.345146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:38.345983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.347637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.347637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:38.347965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:14:38.348128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:38.350389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:38.378917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1121/2245] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:14:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:14:38.381377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95958b73-7ccc-4fff-933d-452b0bb45362 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:38.395076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95958b73-7ccc-4fff-933d-452b0bb45362 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:38.480549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068943-2867-4d64-b26b-ef1cfd8c76c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:38.480549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068943-2867-4d64-b26b-ef1cfd8c76c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.480549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068943-2867-4d64-b26b-ef1cfd8c76c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.480549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068943-2867-4d64-b26b-ef1cfd8c76c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:38.481030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068943-2867-4d64-b26b-ef1cfd8c76c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:38.481030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068943-2867-4d64-b26b-ef1cfd8c76c7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:38.764756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1125/2246] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:38 2022] POST /identity/v3/projects => generated 384 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:14:38.765499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:38.779010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec89a-209b-4f05-b8c3-9124b3c02a04 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:38.853912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01b83-9b72-4a8d-8932-f9e39d20bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:38.854884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01b83-9b72-4a8d-8932-f9e39d20bb0a admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.855241 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01b83-9b72-4a8d-8932-f9e39d20bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.856812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01b83-9b72-4a8d-8932-f9e39d20bb0a admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:38.857703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01b83-9b72-4a8d-8932-f9e39d20bb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:38.864565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01b83-9b72-4a8d-8932-f9e39d20bb0a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:39.035149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068943-2867-4d64-b26b-ef1cfd8c76c7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:39.042200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1122/2247] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:38 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:14:39.050152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068943-2867-4d64-b26b-ef1cfd8c76c7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:39.056692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e3bba-ed73-464c-ad7f-ad8320b1dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:39.057676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3bba-ed73-464c-ad7f-ad8320b1dc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.058113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3bba-ed73-464c-ad7f-ad8320b1dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.058827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3bba-ed73-464c-ad7f-ad8320b1dc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.059856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e3bba-ed73-464c-ad7f-ad8320b1dc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:39.061786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e3bba-ed73-464c-ad7f-ad8320b1dc3a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:39.087149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1126/2248] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:39 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:14:39.088065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01b83-9b72-4a8d-8932-f9e39d20bb0a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:39.101443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01b83-9b72-4a8d-8932-f9e39d20bb0a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:39.109461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43216f96-05ac-4c27-b531-e5a4865a3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:39.114590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43216f96-05ac-4c27-b531-e5a4865a3aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.114590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43216f96-05ac-4c27-b531-e5a4865a3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.114590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43216f96-05ac-4c27-b531-e5a4865a3aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.114590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43216f96-05ac-4c27-b531-e5a4865a3aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:39.118869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43216f96-05ac-4c27-b531-e5a4865a3aa5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:39.142901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1123/2249] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:39 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:39.144347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e3bba-ed73-464c-ad7f-ad8320b1dc3a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:39.167413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e3bba-ed73-464c-ad7f-ad8320b1dc3a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:39.174437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5208a-ed01-47c4-8191-8edb44d29283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:39.176119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5208a-ed01-47c4-8191-8edb44d29283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.176598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5208a-ed01-47c4-8191-8edb44d29283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.177036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5208a-ed01-47c4-8191-8edb44d29283 admin admin] PATH_INFO: `/v3/projects/56ce3bed7ba2422db12d2fa5943c95aa/users/a53929a9feb44821895290010d785d19/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.210743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5208a-ed01-47c4-8191-8edb44d29283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ce3bed7ba2422db12d2fa5943c95aa, user_id=a53929a9feb44821895290010d785d19, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:39.225079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5208a-ed01-47c4-8191-8edb44d29283 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:39.312347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1127/2250] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:39 2022] PUT /identity/v3/projects/56ce3bed7ba2422db12d2fa5943c95aa/users/a53929a9feb44821895290010d785d19/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:14:39.316779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d7b4-4f6e-46f6-b71d-86f849d6a2e8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.317260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d7b4-4f6e-46f6-b71d-86f849d6a2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.319048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d7b4-4f6e-46f6-b71d-86f849d6a2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.353110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8ed2d7b4-4f6e-46f6-b71d-86f849d6a2e8 None None] MFA Rules not processed for user `a53929a9feb44821895290010d785d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:39.354436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8ed2d7b4-4f6e-46f6-b71d-86f849d6a2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:39.474110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1124/2251] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:39.478656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5208a-ed01-47c4-8191-8edb44d29283 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:39.579209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5208a-ed01-47c4-8191-8edb44d29283 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:39.585141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9ed6-1792-4c8b-a0ca-f8551b6fe779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:39.585841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9ed6-1792-4c8b-a0ca-f8551b6fe779 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.586257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9ed6-1792-4c8b-a0ca-f8551b6fe779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.586577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9ed6-1792-4c8b-a0ca-f8551b6fe779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.587395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9ed6-1792-4c8b-a0ca-f8551b6fe779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:39.589661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9ed6-1792-4c8b-a0ca-f8551b6fe779 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:39.694877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1128/2252] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:39 2022] POST /identity/v3/projects => generated 388 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:39.698988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2d7b4-4f6e-46f6-b71d-86f849d6a2e8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:39.715984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2d7b4-4f6e-46f6-b71d-86f849d6a2e8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:39.823261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1dcd-a276-467b-8f76-30ff1a33b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:39.824481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1dcd-a276-467b-8f76-30ff1a33b484 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.824812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1dcd-a276-467b-8f76-30ff1a33b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.825283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1dcd-a276-467b-8f76-30ff1a33b484 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.826153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e1dcd-a276-467b-8f76-30ff1a33b484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:39.829138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e1dcd-a276-467b-8f76-30ff1a33b484 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:39.852086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:39.948071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1125/2253] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:39 2022] POST /identity/v3/users => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:14:39.952845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9ed6-1792-4c8b-a0ca-f8551b6fe779 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:39.971376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9ed6-1792-4c8b-a0ca-f8551b6fe779 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:39.986155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db761d-c8d7-47f0-b4f5-e9d291dc3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:39.987342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db761d-c8d7-47f0-b4f5-e9d291dc3af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.987913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db761d-c8d7-47f0-b4f5-e9d291dc3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.988483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db761d-c8d7-47f0-b4f5-e9d291dc3af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.989792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db761d-c8d7-47f0-b4f5-e9d291dc3af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:39.991524 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db761d-c8d7-47f0-b4f5-e9d291dc3af9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:40.015117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1129/2254] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:39 2022] GET /identity/v3/roles => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:14:40.019838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1dcd-a276-467b-8f76-30ff1a33b484 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:40.033272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1dcd-a276-467b-8f76-30ff1a33b484 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:40.038568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97d431-6d13-42d9-8236-11329c4e84d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:40.039456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97d431-6d13-42d9-8236-11329c4e84d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.039739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97d431-6d13-42d9-8236-11329c4e84d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.040018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97d431-6d13-42d9-8236-11329c4e84d1 admin admin] PATH_INFO: `/v3/projects/72a6959ba8bc45819bbe8e8b2df11c0b/users/fdfbaf65691047cf84ee0060d07a7258/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:40.062800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97d431-6d13-42d9-8236-11329c4e84d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a6959ba8bc45819bbe8e8b2df11c0b, user_id=fdfbaf65691047cf84ee0060d07a7258, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:40.068901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97d431-6d13-42d9-8236-11329c4e84d1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:40.146135 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1126/2255] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:40 2022] PUT /identity/v3/projects/72a6959ba8bc45819bbe8e8b2df11c0b/users/fdfbaf65691047cf84ee0060d07a7258/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:40.150531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db761d-c8d7-47f0-b4f5-e9d291dc3af9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:40.163564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db761d-c8d7-47f0-b4f5-e9d291dc3af9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:40.262296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12826d3b-7978-490b-b1b5-f253d4725ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:40.262296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826d3b-7978-490b-b1b5-f253d4725ced admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.262296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826d3b-7978-490b-b1b5-f253d4725ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.262296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826d3b-7978-490b-b1b5-f253d4725ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:40.262674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12826d3b-7978-490b-b1b5-f253d4725ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:40.262674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12826d3b-7978-490b-b1b5-f253d4725ced admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:40.273481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1130/2256] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:40 2022] GET /identity/v3/roles => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:40.275329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97d431-6d13-42d9-8236-11329c4e84d1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:40.303080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97d431-6d13-42d9-8236-11329c4e84d1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:40.312447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:40.322067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:40.326407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.327152 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.328260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] PATH_INFO: `/v3/projects/72a6959ba8bc45819bbe8e8b2df11c0b/users/fdfbaf65691047cf84ee0060d07a7258/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:40.337369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a6959ba8bc45819bbe8e8b2df11c0b, user_id=fdfbaf65691047cf84ee0060d07a7258, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:40.340949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:40.370744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1127/2257] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:40 2022] PUT /identity/v3/projects/72a6959ba8bc45819bbe8e8b2df11c0b/users/fdfbaf65691047cf84ee0060d07a7258/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:40.383874 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51ef63-7743-4b3f-b496-93def9350df5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.390483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51ef63-7743-4b3f-b496-93def9350df5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.390483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51ef63-7743-4b3f-b496-93def9350df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:40.439306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1a51ef63-7743-4b3f-b496-93def9350df5 None None] MFA Rules not processed for user `fdfbaf65691047cf84ee0060d07a7258`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:40.440558 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1a51ef63-7743-4b3f-b496-93def9350df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:40.611785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1131/2258] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:40.626049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:40.631752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:40.715831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c81bf2-3e12-465c-aff7-d54af465a7ad admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:40.726511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98199a-204c-4915-ae99-279ceb058c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:40.727159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98199a-204c-4915-ae99-279ceb058c67 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.727439 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98199a-204c-4915-ae99-279ceb058c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.727714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98199a-204c-4915-ae99-279ceb058c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:40.738487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98199a-204c-4915-ae99-279ceb058c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:40.739938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98199a-204c-4915-ae99-279ceb058c67 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:40.756578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1128/2259] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:40.830951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51ef63-7743-4b3f-b496-93def9350df5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:40.912880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51ef63-7743-4b3f-b496-93def9350df5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:40.921516 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:40.922390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.922664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.922972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] PATH_INFO: `/v3/users/a53929a9feb44821895290010d785d19` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:40.924254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53929a9feb44821895290010d785d19)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:40.927882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:41.171936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53929a9feb44821895290010d785d19'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:41.172775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53929a9feb44821895290010d785d19'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:41.173921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53929a9feb44821895290010d785d19'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:41.200132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53929a9feb44821895290010d785d19'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:41.212600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53929a9feb44821895290010d785d19'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:41.296967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1132/2260] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:40 2022] DELETE /identity/v3/users/a53929a9feb44821895290010d785d19 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:41.307272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826beb40-60e6-4873-975b-0cdd45f62427 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:41.307855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826beb40-60e6-4873-975b-0cdd45f62427 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:41.307855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826beb40-60e6-4873-975b-0cdd45f62427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:41.327639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-826beb40-60e6-4873-975b-0cdd45f62427 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:41.328857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-826beb40-60e6-4873-975b-0cdd45f62427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:41.405744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1129/2261] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:41.419550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:41.421041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:41.486733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2d18b-8678-4025-bee4-3cd364901b71 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:41.491600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2497-a31a-4357-b173-d5a7119264f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:41.492271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2497-a31a-4357-b173-d5a7119264f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:41.492723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2497-a31a-4357-b173-d5a7119264f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:41.492969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2497-a31a-4357-b173-d5a7119264f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:41.507138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2497-a31a-4357-b173-d5a7119264f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:41.508612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2497-a31a-4357-b173-d5a7119264f1 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:41.519518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1133/2262] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:42.163020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826beb40-60e6-4873-975b-0cdd45f62427 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:42.167313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-826beb40-60e6-4873-975b-0cdd45f62427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:42.182049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826beb40-60e6-4873-975b-0cdd45f62427 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:42.189699 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:42.190636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:42.190921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:42.191204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] PATH_INFO: `/v3/projects/56ce3bed7ba2422db12d2fa5943c95aa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:42.192521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ce3bed7ba2422db12d2fa5943c95aa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:42.194567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:42.235654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:42.362617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ce3bed7ba2422db12d2fa5943c95aa', 'request_id': 'req-ee603ae5-8af7-4b8a-866d-c83df112bb75'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.446974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ce3bed7ba2422db12d2fa5943c95aa', 'request_id': 'req-ee603ae5-8af7-4b8a-866d-c83df112bb75'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.455485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ce3bed7ba2422db12d2fa5943c95aa', 'request_id': 'req-ee603ae5-8af7-4b8a-866d-c83df112bb75'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.475186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] The token cache is being invalidate because project 56ce3bed7ba2422db12d2fa5943c95aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:42.476295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.477708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.480957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1130/2263] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:42 2022] DELETE /identity/v3/projects/56ce3bed7ba2422db12d2fa5943c95aa => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:42.485801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2497-a31a-4357-b173-d5a7119264f1 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:42.497304 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2497-a31a-4357-b173-d5a7119264f1 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:42.566245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:42.567174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:42.567505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:42.567803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] PATH_INFO: `/v3/users/fdfbaf65691047cf84ee0060d07a7258` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:42.569056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdfbaf65691047cf84ee0060d07a7258)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:42.571029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:42.632958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:42.801021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdfbaf65691047cf84ee0060d07a7258'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.802240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdfbaf65691047cf84ee0060d07a7258'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.802879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdfbaf65691047cf84ee0060d07a7258'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.819824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdfbaf65691047cf84ee0060d07a7258'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.831312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-afd16450-27f0-42ed-8074-7a9956f67a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdfbaf65691047cf84ee0060d07a7258'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:42.916904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1134/2264] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:42 2022] DELETE /identity/v3/users/fdfbaf65691047cf84ee0060d07a7258 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:43.632263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:43.640020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:43.674315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee603ae5-8af7-4b8a-866d-c83df112bb75 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:43.794391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:43.795573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:43.795812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:43.796176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] PATH_INFO: `/v3/projects/72a6959ba8bc45819bbe8e8b2df11c0b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:43.797698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a6959ba8bc45819bbe8e8b2df11c0b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:43.800876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:43.932670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a6959ba8bc45819bbe8e8b2df11c0b', 'request_id': 'req-cc675712-7387-4fbd-91e6-6e6b63b276a5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:44.007986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a6959ba8bc45819bbe8e8b2df11c0b', 'request_id': 'req-cc675712-7387-4fbd-91e6-6e6b63b276a5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:44.018007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a6959ba8bc45819bbe8e8b2df11c0b', 'request_id': 'req-cc675712-7387-4fbd-91e6-6e6b63b276a5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:44.038197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] The token cache is being invalidate because project 72a6959ba8bc45819bbe8e8b2df11c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:44.038914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:44.040485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-cc675712-7387-4fbd-91e6-6e6b63b276a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:44.044614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1131/2265] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:43 2022] DELETE /identity/v3/projects/72a6959ba8bc45819bbe8e8b2df11c0b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:44.051113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1effd9-94b8-4d3b-a77d-74d49969bf5b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.051575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1effd9-94b8-4d3b-a77d-74d49969bf5b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.051668 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1effd9-94b8-4d3b-a77d-74d49969bf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.071753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1c1effd9-94b8-4d3b-a77d-74d49969bf5b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:44.073351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1c1effd9-94b8-4d3b-a77d-74d49969bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:44.156837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1135/2266] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:44.159506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1edd0b-3f74-4e46-9199-b183dc10e0b6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.160089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1edd0b-3f74-4e46-9199-b183dc10e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.160584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1edd0b-3f74-4e46-9199-b183dc10e0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.212958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ed1edd0b-3f74-4e46-9199-b183dc10e0b6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:44.214993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ed1edd0b-3f74-4e46-9199-b183dc10e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:44.228416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1132/2267] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:44.229649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1effd9-94b8-4d3b-a77d-74d49969bf5b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:44.252546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1effd9-94b8-4d3b-a77d-74d49969bf5b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:44.261752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:44.263184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.263547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.263899 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.265477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:14:44.265897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:44.268636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:44.305156 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1136/2268] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:14:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:14:44.315420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1edd0b-3f74-4e46-9199-b183dc10e0b6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:44.335029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1edd0b-3f74-4e46-9199-b183dc10e0b6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:44.342154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2183b-b11d-4a79-8a09-2cca2d137948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:44.344724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2183b-b11d-4a79-8a09-2cca2d137948 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.345246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2183b-b11d-4a79-8a09-2cca2d137948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.345724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2183b-b11d-4a79-8a09-2cca2d137948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.347272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2183b-b11d-4a79-8a09-2cca2d137948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:44.349716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2183b-b11d-4a79-8a09-2cca2d137948 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:44.486688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1133/2269] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:44 2022] POST /identity/v3/projects => generated 388 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:44.488023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:44.501068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f764be8-3fe9-4a6c-aa06-63b4f5d4804c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:44.599898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bc997-9985-4462-8ff5-f35310fc0987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:44.600786 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bc997-9985-4462-8ff5-f35310fc0987 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.601168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bc997-9985-4462-8ff5-f35310fc0987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.601542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bc997-9985-4462-8ff5-f35310fc0987 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.602301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bc997-9985-4462-8ff5-f35310fc0987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:44.604815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bc997-9985-4462-8ff5-f35310fc0987 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:44.626814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:44.681345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1137/2270] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:44 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:44.686389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2183b-b11d-4a79-8a09-2cca2d137948 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:44.698894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2183b-b11d-4a79-8a09-2cca2d137948 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:44.704702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c757-6409-463a-b183-1bc100550b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:44.705585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c757-6409-463a-b183-1bc100550b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.706024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c757-6409-463a-b183-1bc100550b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.706437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c757-6409-463a-b183-1bc100550b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.707442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902c757-6409-463a-b183-1bc100550b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:44.713346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902c757-6409-463a-b183-1bc100550b69 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:44.724423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1134/2271] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:44 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:44.729153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bc997-9985-4462-8ff5-f35310fc0987 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:44.733514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=1,keystone:INSERT=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:44.742601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bc997-9985-4462-8ff5-f35310fc0987 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:44.747932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6b2a9-ab78-4187-aece-c4ef8a9efd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:44.748903 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2a9-ab78-4187-aece-c4ef8a9efd5e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.749352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2a9-ab78-4187-aece-c4ef8a9efd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.749778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2a9-ab78-4187-aece-c4ef8a9efd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.750654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6b2a9-ab78-4187-aece-c4ef8a9efd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:44.752478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6b2a9-ab78-4187-aece-c4ef8a9efd5e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:44.765343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1138/2272] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:44 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:14:44.769258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c757-6409-463a-b183-1bc100550b69 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:44.780702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c757-6409-463a-b183-1bc100550b69 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:44.785595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46356d-e93b-43df-bd26-95333f80466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:44.786486 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46356d-e93b-43df-bd26-95333f80466d admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.786772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46356d-e93b-43df-bd26-95333f80466d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.787047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46356d-e93b-43df-bd26-95333f80466d admin admin] PATH_INFO: `/v3/projects/e637b084d9154274a78656e29766061e/users/7ceee2352da54aea9b4e784343af7159/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.804242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46356d-e93b-43df-bd26-95333f80466d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e637b084d9154274a78656e29766061e, user_id=7ceee2352da54aea9b4e784343af7159, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:44.806908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46356d-e93b-43df-bd26-95333f80466d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:44.872620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1135/2273] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:44 2022] PUT /identity/v3/projects/e637b084d9154274a78656e29766061e/users/7ceee2352da54aea9b4e784343af7159/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:44.881930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974741d-7108-4ccf-978e-3d3a74fdb107 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.882243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974741d-7108-4ccf-978e-3d3a74fdb107 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.882544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974741d-7108-4ccf-978e-3d3a74fdb107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.935924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8974741d-7108-4ccf-978e-3d3a74fdb107 None None] MFA Rules not processed for user `7ceee2352da54aea9b4e784343af7159`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:44.937335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8974741d-7108-4ccf-978e-3d3a74fdb107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:45.017684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1139/2274] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:45.022015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46356d-e93b-43df-bd26-95333f80466d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:45.119654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46356d-e93b-43df-bd26-95333f80466d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:45.126068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b21ccf-46a0-4e67-b49b-a85c69087fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:45.126790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21ccf-46a0-4e67-b49b-a85c69087fdb admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:45.127082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21ccf-46a0-4e67-b49b-a85c69087fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:45.127401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21ccf-46a0-4e67-b49b-a85c69087fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:45.128377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b21ccf-46a0-4e67-b49b-a85c69087fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:45.130368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b21ccf-46a0-4e67-b49b-a85c69087fdb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:45.229182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1136/2275] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:45 2022] POST /identity/v3/projects => generated 390 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:45.234223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974741d-7108-4ccf-978e-3d3a74fdb107 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:45.249875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974741d-7108-4ccf-978e-3d3a74fdb107 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:45.321481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692a441-3665-41ef-8f2e-96a2688276af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:45.324528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692a441-3665-41ef-8f2e-96a2688276af admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:45.324528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692a441-3665-41ef-8f2e-96a2688276af admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:45.324528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692a441-3665-41ef-8f2e-96a2688276af admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:45.333659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692a441-3665-41ef-8f2e-96a2688276af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:45.335768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692a441-3665-41ef-8f2e-96a2688276af admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:45.456191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1140/2276] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:45 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:45.460472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b21ccf-46a0-4e67-b49b-a85c69087fdb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:45.474297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b21ccf-46a0-4e67-b49b-a85c69087fdb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:45.483973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c576070-f6ba-4d99-a796-985286f96357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:45.484946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c576070-f6ba-4d99-a796-985286f96357 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:45.485234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c576070-f6ba-4d99-a796-985286f96357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:45.493174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c576070-f6ba-4d99-a796-985286f96357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:45.493174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c576070-f6ba-4d99-a796-985286f96357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:45.493174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c576070-f6ba-4d99-a796-985286f96357 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:45.520763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1137/2277] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:45 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:45.524259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692a441-3665-41ef-8f2e-96a2688276af admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:45.536172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692a441-3665-41ef-8f2e-96a2688276af admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:45.544231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c0ae-ba45-4a5b-8f7f-a67d74d73270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:45.546024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c0ae-ba45-4a5b-8f7f-a67d74d73270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:45.546381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c0ae-ba45-4a5b-8f7f-a67d74d73270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:45.546772 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c0ae-ba45-4a5b-8f7f-a67d74d73270 admin admin] PATH_INFO: `/v3/projects/bd1ef9eef7474f7db829a708d0411220/users/bfa222db87da482193c362aa08d84f3f/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:45.566206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635c0ae-ba45-4a5b-8f7f-a67d74d73270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1ef9eef7474f7db829a708d0411220, user_id=bfa222db87da482193c362aa08d84f3f, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:45.569844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635c0ae-ba45-4a5b-8f7f-a67d74d73270 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:46.096080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1141/2278] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:45 2022] PUT /identity/v3/projects/bd1ef9eef7474f7db829a708d0411220/users/bfa222db87da482193c362aa08d84f3f/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:14:46.101899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c576070-f6ba-4d99-a796-985286f96357 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:46.118626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c576070-f6ba-4d99-a796-985286f96357 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:46.193819 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc35b22-1ba7-4f38-8f0b-5c349e90b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:46.194406 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35b22-1ba7-4f38-8f0b-5c349e90b475 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:46.194604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35b22-1ba7-4f38-8f0b-5c349e90b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:46.194879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35b22-1ba7-4f38-8f0b-5c349e90b475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:46.195975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc35b22-1ba7-4f38-8f0b-5c349e90b475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:46.198307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc35b22-1ba7-4f38-8f0b-5c349e90b475 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:46.237330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1138/2279] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:46 2022] GET /identity/v3/roles => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:14:46.241315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c0ae-ba45-4a5b-8f7f-a67d74d73270 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:46.253447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c0ae-ba45-4a5b-8f7f-a67d74d73270 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:46.259319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:46.260528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:46.260951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:46.261736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] PATH_INFO: `/v3/projects/bd1ef9eef7474f7db829a708d0411220/users/bfa222db87da482193c362aa08d84f3f/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:46.264239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1ef9eef7474f7db829a708d0411220, user_id=bfa222db87da482193c362aa08d84f3f, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:46.266628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:46.278417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1142/2280] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:46 2022] PUT /identity/v3/projects/bd1ef9eef7474f7db829a708d0411220/users/bfa222db87da482193c362aa08d84f3f/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:46.290799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76a8be-1088-4ec4-9196-86e0cc147e18 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:46.291343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76a8be-1088-4ec4-9196-86e0cc147e18 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:46.291795 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76a8be-1088-4ec4-9196-86e0cc147e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:46.336843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6d76a8be-1088-4ec4-9196-86e0cc147e18 None None] MFA Rules not processed for user `bfa222db87da482193c362aa08d84f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:46.338454 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6d76a8be-1088-4ec4-9196-86e0cc147e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:46.435759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1139/2281] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:46.448423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:46.450513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:46.524631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff5b18-4817-4363-a037-c70c19a57e5f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:46.535971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d5aa4-1904-41d6-9b29-71540dc18655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:46.536750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5aa4-1904-41d6-9b29-71540dc18655 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:46.537599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5aa4-1904-41d6-9b29-71540dc18655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:46.537954 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5aa4-1904-41d6-9b29-71540dc18655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:46.549190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d5aa4-1904-41d6-9b29-71540dc18655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:46.550818 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d5aa4-1904-41d6-9b29-71540dc18655 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:46.573378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1143/2282] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:46.587217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:46.748079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:46.797276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76a8be-1088-4ec4-9196-86e0cc147e18 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:46.960334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76a8be-1088-4ec4-9196-86e0cc147e18 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:46.966472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:46.967374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:46.967652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:46.967923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] PATH_INFO: `/v3/users/7ceee2352da54aea9b4e784343af7159` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:46.969408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ceee2352da54aea9b4e784343af7159)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:46.971457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:47.216542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ceee2352da54aea9b4e784343af7159'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:47.216542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ceee2352da54aea9b4e784343af7159'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:47.216542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ceee2352da54aea9b4e784343af7159'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:47.229952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ceee2352da54aea9b4e784343af7159'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:47.244701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ceee2352da54aea9b4e784343af7159'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:47.341603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1140/2283] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:46 2022] DELETE /identity/v3/users/7ceee2352da54aea9b4e784343af7159 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:47.346233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff939-acc9-4b16-91e8-69df484e04c3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:47.346725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff939-acc9-4b16-91e8-69df484e04c3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:47.346833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff939-acc9-4b16-91e8-69df484e04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:47.373078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6c4ff939-acc9-4b16-91e8-69df484e04c3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:47.379567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6c4ff939-acc9-4b16-91e8-69df484e04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:47.459233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1144/2284] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:47.465930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:47.467627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:47.536554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dba7f-22d3-44c6-ab61-6daaa94d2ed1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:47.540574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e4f2-5ecf-47d0-9846-bc0d03c299d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:47.541223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e4f2-5ecf-47d0-9846-bc0d03c299d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:47.541502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e4f2-5ecf-47d0-9846-bc0d03c299d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:47.541780 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e4f2-5ecf-47d0-9846-bc0d03c299d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:47.553390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e4f2-5ecf-47d0-9846-bc0d03c299d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:47.554843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e4f2-5ecf-47d0-9846-bc0d03c299d5 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:47.567690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1141/2285] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:47.573001 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:48.172847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:48.278365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ff939-acc9-4b16-91e8-69df484e04c3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:48.281109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6c4ff939-acc9-4b16-91e8-69df484e04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:48.305891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ff939-acc9-4b16-91e8-69df484e04c3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:48.322782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:48.324427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:48.325446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:48.326262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] PATH_INFO: `/v3/projects/e637b084d9154274a78656e29766061e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:48.330659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e637b084d9154274a78656e29766061e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:48.333742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:48.504029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e637b084d9154274a78656e29766061e', 'request_id': 'req-bcde62c2-0eec-4a26-a734-1c8eccc04487'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.590465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e637b084d9154274a78656e29766061e', 'request_id': 'req-bcde62c2-0eec-4a26-a734-1c8eccc04487'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.600544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e637b084d9154274a78656e29766061e', 'request_id': 'req-bcde62c2-0eec-4a26-a734-1c8eccc04487'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.616753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] The token cache is being invalidate because project e637b084d9154274a78656e29766061e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:48.617362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.618628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.620625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1145/2286] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:48 2022] DELETE /identity/v3/projects/e637b084d9154274a78656e29766061e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:48.624623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e4f2-5ecf-47d0-9846-bc0d03c299d5 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:48.639292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e4f2-5ecf-47d0-9846-bc0d03c299d5 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:48.675921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:48.737128 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:48.739830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:48.740577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:48.741121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:48.741734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] PATH_INFO: `/v3/users/bfa222db87da482193c362aa08d84f3f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:48.743415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa222db87da482193c362aa08d84f3f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:48.745677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:48.921236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa222db87da482193c362aa08d84f3f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.921892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa222db87da482193c362aa08d84f3f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.922524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa222db87da482193c362aa08d84f3f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.941980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa222db87da482193c362aa08d84f3f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:48.949902 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa222db87da482193c362aa08d84f3f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:49.065772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1142/2287] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:48 2022] DELETE /identity/v3/users/bfa222db87da482193c362aa08d84f3f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:49.115841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:49.130188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:49.132908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:49.156009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde62c2-0eec-4a26-a734-1c8eccc04487 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:49.277398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:49.278357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:49.278789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:49.279088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] PATH_INFO: `/v3/users/c06318ec675c4f0db1ac530c27eb9472` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:49.281313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06318ec675c4f0db1ac530c27eb9472)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:49.283511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:49.303226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:49.562231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:49.608945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06318ec675c4f0db1ac530c27eb9472'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:49.612009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06318ec675c4f0db1ac530c27eb9472'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:49.614377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06318ec675c4f0db1ac530c27eb9472'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:49.635802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06318ec675c4f0db1ac530c27eb9472'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:49.645956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4bd8ad5d-ce27-4cb3-baec-a83c7e189c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06318ec675c4f0db1ac530c27eb9472'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:50.191185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:50.195640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:50.207446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1146/2288] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:14:49 2022] DELETE /identity/v3/users/c06318ec675c4f0db1ac530c27eb9472 => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:50.212636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20431b-daa7-4581-beac-696ef9bafa48 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:50.216764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20431b-daa7-4581-beac-696ef9bafa48 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:50.217705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20431b-daa7-4581-beac-696ef9bafa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:50.240859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f33600-1999-41cf-a164-e6c23a8ee2c5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:50.256325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0e20431b-daa7-4581-beac-696ef9bafa48 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:50.258446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0e20431b-daa7-4581-beac-696ef9bafa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:50.363824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1147/2289] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:50.371821 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20431b-daa7-4581-beac-696ef9bafa48 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:50.375057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0e20431b-daa7-4581-beac-696ef9bafa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:50.377812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:50.378840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:50.379126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:50.379538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] PATH_INFO: `/v3/projects/bd1ef9eef7474f7db829a708d0411220` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:50.381569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1ef9eef7474f7db829a708d0411220)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:50.386681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:50.499842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:50.508228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20431b-daa7-4581-beac-696ef9bafa48 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:50.508511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ed55-f4fd-4872-b516-059ba6547808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:50.509238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ed55-f4fd-4872-b516-059ba6547808 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:50.509587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ed55-f4fd-4872-b516-059ba6547808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:50.509947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ed55-f4fd-4872-b516-059ba6547808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:50.531231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ed55-f4fd-4872-b516-059ba6547808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:50.532800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ed55-f4fd-4872-b516-059ba6547808 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:50.562163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1ef9eef7474f7db829a708d0411220', 'request_id': 'req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:50.569658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1148/2290] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:14:50.622255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:50.649643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1ef9eef7474f7db829a708d0411220', 'request_id': 'req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:50.661244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1ef9eef7474f7db829a708d0411220', 'request_id': 'req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:50.686338 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] The token cache is being invalidate because project bd1ef9eef7474f7db829a708d0411220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:50.686864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:50.688836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b394d6f9-fcae-4aa8-a1c4-ddc1896e4d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:50.696381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1143/2291] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:50 2022] DELETE /identity/v3/projects/bd1ef9eef7474f7db829a708d0411220 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:50.698365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14336-c530-4fb0-89e2-16607c5438ea None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:50.698850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14336-c530-4fb0-89e2-16607c5438ea None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:50.698957 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f14336-c530-4fb0-89e2-16607c5438ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:50.749695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-80f14336-c530-4fb0-89e2-16607c5438ea None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:50.755543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-80f14336-c530-4fb0-89e2-16607c5438ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:50.883611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1149/2292] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:50.891280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa79b-0ede-4441-abe0-7faf81cc3ae5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:50.891718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa79b-0ede-4441-abe0-7faf81cc3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:50.892096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa79b-0ede-4441-abe0-7faf81cc3ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:50.932205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2ccfa79b-0ede-4441-abe0-7faf81cc3ae5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:50.933710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2ccfa79b-0ede-4441-abe0-7faf81cc3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:50.947019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1144/2293] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:50.951885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f14336-c530-4fb0-89e2-16607c5438ea None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:50.969591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f14336-c530-4fb0-89e2-16607c5438ea None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:50.986958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:50.987867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:50.988294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:50.991219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:50.991219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:14:50.991219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:50.991823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.021926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1150/2294] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:14:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:14:51.024658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:51.032135 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfa79b-0ede-4441-abe0-7faf81cc3ae5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.050640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfa79b-0ede-4441-abe0-7faf81cc3ae5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.060069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4286d-c09f-44ff-9171-8173b1b801cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.060958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4286d-c09f-44ff-9171-8173b1b801cd admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.061549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4286d-c09f-44ff-9171-8173b1b801cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.062103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4286d-c09f-44ff-9171-8173b1b801cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.064036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4286d-c09f-44ff-9171-8173b1b801cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.066512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4286d-c09f-44ff-9171-8173b1b801cd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.101629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:51.174791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1145/2295] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:51 2022] POST /identity/v3/projects => generated 374 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:51.180416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.184425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:51.189871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4286d-c09f-44ff-9171-8173b1b801cd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.204884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd82bb-db0c-4e90-9451-c479fccd72e8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.276197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4286d-c09f-44ff-9171-8173b1b801cd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.283687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2d1b8-a6c6-4147-ac66-def75bfaf0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.284808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d1b8-a6c6-4147-ac66-def75bfaf0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.291518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d1b8-a6c6-4147-ac66-def75bfaf0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.291518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d1b8-a6c6-4147-ac66-def75bfaf0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.291518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2d1b8-a6c6-4147-ac66-def75bfaf0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.291518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2d1b8-a6c6-4147-ac66-def75bfaf0b0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.302341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.303296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.303940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.304228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] PATH_INFO: `/v3/projects/923cc64f912745b89b385c5417757099` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.305651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] RBAC: Authorizing `identity:delete_project(project_id=923cc64f912745b89b385c5417757099)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.307952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.443068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1146/2296] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:51 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:51.447154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2d1b8-a6c6-4147-ac66-def75bfaf0b0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.459583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2d1b8-a6c6-4147-ac66-def75bfaf0b0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.471787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923cc64f912745b89b385c5417757099', 'request_id': 'req-1d6baee1-b439-4f34-8dc8-515ee8f055df'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:51.523075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24654d03-c23c-4187-aabc-bf1f23b5ea36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.523674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654d03-c23c-4187-aabc-bf1f23b5ea36 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.523962 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654d03-c23c-4187-aabc-bf1f23b5ea36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.524235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654d03-c23c-4187-aabc-bf1f23b5ea36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.524992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24654d03-c23c-4187-aabc-bf1f23b5ea36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.526619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24654d03-c23c-4187-aabc-bf1f23b5ea36 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.540658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1147/2297] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:51 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:51.544643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24654d03-c23c-4187-aabc-bf1f23b5ea36 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.554586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24654d03-c23c-4187-aabc-bf1f23b5ea36 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.561666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bbee6-f02e-41bc-8cde-a96e2c59fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.562322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bbee6-f02e-41bc-8cde-a96e2c59fdff admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.562606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bbee6-f02e-41bc-8cde-a96e2c59fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.562915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bbee6-f02e-41bc-8cde-a96e2c59fdff admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.563597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bbee6-f02e-41bc-8cde-a96e2c59fdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.565261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bbee6-f02e-41bc-8cde-a96e2c59fdff admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.578651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1148/2298] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:51 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:14:51.579637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bbee6-f02e-41bc-8cde-a96e2c59fdff admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.593428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bbee6-f02e-41bc-8cde-a96e2c59fdff admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.602412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb02815-4c8c-4f40-8dcc-83420bad57d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.603265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb02815-4c8c-4f40-8dcc-83420bad57d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.603547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb02815-4c8c-4f40-8dcc-83420bad57d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.603827 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb02815-4c8c-4f40-8dcc-83420bad57d5 admin admin] PATH_INFO: `/v3/projects/ba3bb3c188ab4000b71012f6ee8c9c35/users/9ac78d65a9014a64a69b39d1abfb3738/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.631354 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb02815-4c8c-4f40-8dcc-83420bad57d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3bb3c188ab4000b71012f6ee8c9c35, user_id=9ac78d65a9014a64a69b39d1abfb3738, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.634201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb02815-4c8c-4f40-8dcc-83420bad57d5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.653517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:51.683800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923cc64f912745b89b385c5417757099', 'request_id': 'req-1d6baee1-b439-4f34-8dc8-515ee8f055df'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:51.691192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923cc64f912745b89b385c5417757099', 'request_id': 'req-1d6baee1-b439-4f34-8dc8-515ee8f055df'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:51.704340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] The token cache is being invalidate because project 923cc64f912745b89b385c5417757099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:14:51.704340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:51.704340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d6baee1-b439-4f34-8dc8-515ee8f055df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:14:51.706086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1151/2299] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:14:51 2022] DELETE /identity/v3/projects/923cc64f912745b89b385c5417757099 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:51.710340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32633d44-6e41-499e-939f-d731ae5f711a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.710718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32633d44-6e41-499e-939f-d731ae5f711a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.711071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32633d44-6e41-499e-939f-d731ae5f711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.732468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-32633d44-6e41-499e-939f-d731ae5f711a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:51.732468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-32633d44-6e41-499e-939f-d731ae5f711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:51.737098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1149/2300] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:51 2022] PUT /identity/v3/projects/ba3bb3c188ab4000b71012f6ee8c9c35/users/9ac78d65a9014a64a69b39d1abfb3738/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:51.749801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ce908-baa5-401e-96a8-0cb834fc46a4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.750091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ce908-baa5-401e-96a8-0cb834fc46a4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.750372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ce908-baa5-401e-96a8-0cb834fc46a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.795195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:51.795195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d40ce908-baa5-401e-96a8-0cb834fc46a4 None None] MFA Rules not processed for user `9ac78d65a9014a64a69b39d1abfb3738`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:51.795195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d40ce908-baa5-401e-96a8-0cb834fc46a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:51.819148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1152/2301] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:51.821613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:51.827921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584702e-b552-4337-b267-f99b12df965e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.828216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584702e-b552-4337-b267-f99b12df965e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.828548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584702e-b552-4337-b267-f99b12df965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.851534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d584702e-b552-4337-b267-f99b12df965e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:51.853059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d584702e-b552-4337-b267-f99b12df965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:51.863640 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1153/2302] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:51.867845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584702e-b552-4337-b267-f99b12df965e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.880389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584702e-b552-4337-b267-f99b12df965e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.884532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1150/2303] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:51.885924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.886594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.887522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.888120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.889149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:14:51.889483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.891323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.897578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ce908-baa5-401e-96a8-0cb834fc46a4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.902937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d40ce908-baa5-401e-96a8-0cb834fc46a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:51.907450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1154/2304] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:14:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:14:51.908477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.918269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ae91f-7eb7-4f94-90de-d6e17cfe36fd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.923338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f03495-08bb-4d6e-9b06-19e584e9a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.923973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f03495-08bb-4d6e-9b06-19e584e9a914 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.924255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f03495-08bb-4d6e-9b06-19e584e9a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.924561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f03495-08bb-4d6e-9b06-19e584e9a914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.928173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f03495-08bb-4d6e-9b06-19e584e9a914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.928699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f03495-08bb-4d6e-9b06-19e584e9a914 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.961019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ce908-baa5-401e-96a8-0cb834fc46a4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.964775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deca94-c15d-41d0-ac1b-1a0a611739b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.965447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deca94-c15d-41d0-ac1b-1a0a611739b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.965726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deca94-c15d-41d0-ac1b-1a0a611739b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.965999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deca94-c15d-41d0-ac1b-1a0a611739b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.975747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deca94-c15d-41d0-ac1b-1a0a611739b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.977339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deca94-c15d-41d0-ac1b-1a0a611739b7 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.987003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1151/2305] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:14:52.031296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1155/2306] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:14:51 2022] POST /identity/v3/projects => generated 372 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:52.040078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deca94-c15d-41d0-ac1b-1a0a611739b7 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:52.045103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:52.067166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deca94-c15d-41d0-ac1b-1a0a611739b7 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:52.124422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:52.136387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d05e6-8287-4ff5-a954-bb3aca2156d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:52.137901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d05e6-8287-4ff5-a954-bb3aca2156d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:52.138242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d05e6-8287-4ff5-a954-bb3aca2156d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:52.138592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d05e6-8287-4ff5-a954-bb3aca2156d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:52.139359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d05e6-8287-4ff5-a954-bb3aca2156d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:52.141575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d05e6-8287-4ff5-a954-bb3aca2156d6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:52.226920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1152/2307] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:14:52 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:14:52.234034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f03495-08bb-4d6e-9b06-19e584e9a914 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:52.244407 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f03495-08bb-4d6e-9b06-19e584e9a914 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:52.249634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bea5b-1eca-4bc6-bfd4-cf83244a403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:52.251276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bea5b-1eca-4bc6-bfd4-cf83244a403b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:52.251276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bea5b-1eca-4bc6-bfd4-cf83244a403b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:52.251276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bea5b-1eca-4bc6-bfd4-cf83244a403b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:52.251544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bea5b-1eca-4bc6-bfd4-cf83244a403b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:52.253116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bea5b-1eca-4bc6-bfd4-cf83244a403b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:52.266327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1156/2308] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:52 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:14:52.267746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d05e6-8287-4ff5-a954-bb3aca2156d6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:52.278722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d05e6-8287-4ff5-a954-bb3aca2156d6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:52.283595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0a380-e789-416b-9dc6-b9d20edb9711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:52.284363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a380-e789-416b-9dc6-b9d20edb9711 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:52.284712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a380-e789-416b-9dc6-b9d20edb9711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:52.285133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a380-e789-416b-9dc6-b9d20edb9711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:52.285907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0a380-e789-416b-9dc6-b9d20edb9711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:52.288114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0a380-e789-416b-9dc6-b9d20edb9711 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:52.307294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1153/2309] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:14:52 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:14:52.311878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bea5b-1eca-4bc6-bfd4-cf83244a403b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:52.321959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bea5b-1eca-4bc6-bfd4-cf83244a403b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:52.326742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:52.327609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:52.327883 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:52.328154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] PATH_INFO: `/v3/projects/37ff375421a9469bb2b275d7e16e2b2c/users/055ed34782bc4c3b9e486aa3cdf138ff/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:52.343081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ff375421a9469bb2b275d7e16e2b2c, user_id=055ed34782bc4c3b9e486aa3cdf138ff, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:52.345801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:52.427192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1157/2310] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:14:52 2022] PUT /identity/v3/projects/37ff375421a9469bb2b275d7e16e2b2c/users/055ed34782bc4c3b9e486aa3cdf138ff/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:14:52.439023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7b0d3-7dc3-4ee3-97e9-4af2c8dccbac None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:52.439349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7b0d3-7dc3-4ee3-97e9-4af2c8dccbac None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:52.439629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7b0d3-7dc3-4ee3-97e9-4af2c8dccbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:52.467210 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-42d7b0d3-7dc3-4ee3-97e9-4af2c8dccbac None None] MFA Rules not processed for user `055ed34782bc4c3b9e486aa3cdf138ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:52.468498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-42d7b0d3-7dc3-4ee3-97e9-4af2c8dccbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:52.542029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:52.563610 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1154/2311] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:14:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:52.575538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:52.577598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:52.615865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:52.666849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dfc18-bcd3-46a8-ba3c-2c2b02a5df20 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:52.671742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b767a2c-2ab3-4c51-b429-d51cd7f31e20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a2c87f8db748ba9264b141f059aab9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:52.672275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b767a2c-2ab3-4c51-b429-d51cd7f31e20 service glance] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:52.672586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b767a2c-2ab3-4c51-b429-d51cd7f31e20 service glance] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:52.672859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b767a2c-2ab3-4c51-b429-d51cd7f31e20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:52.682659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b767a2c-2ab3-4c51-b429-d51cd7f31e20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:52.683743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b767a2c-2ab3-4c51-b429-d51cd7f31e20 service glance] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:52.692926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1158/2312] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:14:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:53.164402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:53.218280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:53.744620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:53.829834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:54.110075 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:54.230007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:54.670381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:54.752841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:54.887627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:55.041088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:55.307537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:55.501193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:55.698544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:56.172563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:56.487126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:56.615768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:56.733455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:56.844264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:57.087723 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:57.230215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:57.286506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:57.373347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:57.469650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:57.594823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:57.642695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:58.002395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:58.048148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:58.132761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:58.218727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:58.504556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:58.561830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:58.803222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:58.889365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:59.158974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:59.189141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:01.106656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e592-279a-4088-8c9d-62b5da20110d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.107203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e592-279a-4088-8c9d-62b5da20110d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.107203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e592-279a-4088-8c9d-62b5da20110d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.110957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1155/2313] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:15:01 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:15:01.116835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc9ca-f672-4585-9a1d-fade1627306d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.117215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc9ca-f672-4585-9a1d-fade1627306d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.117458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc9ca-f672-4585-9a1d-fade1627306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.182361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-397bc9ca-f672-4585-9a1d-fade1627306d None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:01.184239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-397bc9ca-f672-4585-9a1d-fade1627306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:01.257081 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:01.311062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1159/2314] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:15:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:01.327200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4e592-279a-4088-8c9d-62b5da20110d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:01.329623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-76e4e592-279a-4088-8c9d-62b5da20110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:01.351826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4e592-279a-4088-8c9d-62b5da20110d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:01.355444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173a83d-7f03-4c1a-b70d-a53f6e1b02d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a2c87f8db748ba9264b141f059aab9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:01.356078 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a83d-7f03-4c1a-b70d-a53f6e1b02d2 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.356444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a83d-7f03-4c1a-b70d-a53f6e1b02d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.356702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a83d-7f03-4c1a-b70d-a53f6e1b02d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.371601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173a83d-7f03-4c1a-b70d-a53f6e1b02d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:01.373095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173a83d-7f03-4c1a-b70d-a53f6e1b02d2 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:01.385355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1156/2315] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:15:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:01.664534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49eab2-e1c4-468f-a5e4-dc769f3493a5 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.665023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49eab2-e1c4-468f-a5e4-dc769f3493a5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.665430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49eab2-e1c4-468f-a5e4-dc769f3493a5 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.667951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1160/2316] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:15:01 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:15:01.674915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ceb6-118d-4cf8-9cac-6ba2fe44dd6a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.675734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ceb6-118d-4cf8-9cac-6ba2fe44dd6a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.676219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ceb6-118d-4cf8-9cac-6ba2fe44dd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.699865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3c71ceb6-118d-4cf8-9cac-6ba2fe44dd6a None None] MFA Rules not processed for user `66452133fd6348109e3065303947ecce`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:01.701283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c71ceb6-118d-4cf8-9cac-6ba2fe44dd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:01.772272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1157/2317] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:15:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:01.786075 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49eab2-e1c4-468f-a5e4-dc769f3493a5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:01.788275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fb49eab2-e1c4-468f-a5e4-dc769f3493a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:01.802865 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49eab2-e1c4-468f-a5e4-dc769f3493a5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:01.806556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee242e-9b81-4309-8ba7-b453968df2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:01.807136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee242e-9b81-4309-8ba7-b453968df2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.807411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee242e-9b81-4309-8ba7-b453968df2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.807685 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee242e-9b81-4309-8ba7-b453968df2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.816227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee242e-9b81-4309-8ba7-b453968df2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:01.817751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee242e-9b81-4309-8ba7-b453968df2b5 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:01.826683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1161/2318] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:15:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:15:01.926983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148869d-6c14-4a54-928c-60902079fd87 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.927992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148869d-6c14-4a54-928c-60902079fd87 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.928555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148869d-6c14-4a54-928c-60902079fd87 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.930217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1158/2319] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:15:01 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:15:01.936364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1625d0-a946-4f0a-b3fc-176ba3c46720 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.937003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1625d0-a946-4f0a-b3fc-176ba3c46720 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.937003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1625d0-a946-4f0a-b3fc-176ba3c46720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.956700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cf1625d0-a946-4f0a-b3fc-176ba3c46720 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:01.957912 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cf1625d0-a946-4f0a-b3fc-176ba3c46720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:01.968968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1162/2320] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:15:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:01.979650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148869d-6c14-4a54-928c-60902079fd87 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:01.991103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148869d-6c14-4a54-928c-60902079fd87 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:01.994714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:01.995344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.995688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.995904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:02.006737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:02.008184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:02.021877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1159/2321] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:15:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:02.801350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5d35-22cb-4305-9c5e-75eb18b46dac None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:02.801868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5d35-22cb-4305-9c5e-75eb18b46dac None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:02.801959 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b5d35-22cb-4305-9c5e-75eb18b46dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:02.821701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-202b5d35-22cb-4305-9c5e-75eb18b46dac None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:02.822934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-202b5d35-22cb-4305-9c5e-75eb18b46dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:02.884401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1163/2322] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:15:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:02.896717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:02.898102 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:02.975884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f5337-5ac0-42db-a416-72838bd9d3c7 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:02.980924 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9daf92-f5a7-415f-b69e-4522943bd083 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:02.981563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9daf92-f5a7-415f-b69e-4522943bd083 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:02.981844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9daf92-f5a7-415f-b69e-4522943bd083 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:02.982116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9daf92-f5a7-415f-b69e-4522943bd083 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:02.991546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9daf92-f5a7-415f-b69e-4522943bd083 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:02.994109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9daf92-f5a7-415f-b69e-4522943bd083 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:03.006733 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1160/2323] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:15:04.824693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b5d35-22cb-4305-9c5e-75eb18b46dac None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:04.826216 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-202b5d35-22cb-4305-9c5e-75eb18b46dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:04.991056 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b5d35-22cb-4305-9c5e-75eb18b46dac None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:05.026029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:05.029144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:05.029811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:05.030100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] PATH_INFO: `/v3/users/9ac78d65a9014a64a69b39d1abfb3738` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:05.051887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac78d65a9014a64a69b39d1abfb3738)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:05.055424 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:05.571850 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac78d65a9014a64a69b39d1abfb3738'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:05.572496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac78d65a9014a64a69b39d1abfb3738'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:05.573085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac78d65a9014a64a69b39d1abfb3738'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:05.586189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:05.590653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac78d65a9014a64a69b39d1abfb3738'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:05.601061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac78d65a9014a64a69b39d1abfb3738'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:05.706921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1164/2324] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:15:04 2022] DELETE /identity/v3/users/9ac78d65a9014a64a69b39d1abfb3738 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:15:05.711828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c84c2-ebad-4d28-a995-13f17dd9bb83 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:05.712574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c84c2-ebad-4d28-a995-13f17dd9bb83 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:05.712574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c84c2-ebad-4d28-a995-13f17dd9bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:05.730637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:05.740920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f48c84c2-ebad-4d28-a995-13f17dd9bb83 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:05.742327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f48c84c2-ebad-4d28-a995-13f17dd9bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:05.855809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1161/2325] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:15:05.866126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:05.867653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:05.941376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25c62-d577-4ff0-833a-9a74a3ad7c0c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:05.946167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b7baa-6a4c-4d0d-9c93-a9017e4c389d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:05.946982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b7baa-6a4c-4d0d-9c93-a9017e4c389d service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:05.947385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b7baa-6a4c-4d0d-9c93-a9017e4c389d service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:05.947502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b7baa-6a4c-4d0d-9c93-a9017e4c389d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:05.961032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b7baa-6a4c-4d0d-9c93-a9017e4c389d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:05.961032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b7baa-6a4c-4d0d-9c93-a9017e4c389d service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:05.974413 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1165/2326] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:06.469531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c84c2-ebad-4d28-a995-13f17dd9bb83 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:06.469531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f48c84c2-ebad-4d28-a995-13f17dd9bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:06.495172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c84c2-ebad-4d28-a995-13f17dd9bb83 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:06.511640 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:06.512636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:06.512922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:06.513198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] PATH_INFO: `/v3/projects/ba3bb3c188ab4000b71012f6ee8c9c35` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:06.514409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3bb3c188ab4000b71012f6ee8c9c35)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:06.518805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:06.654660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3bb3c188ab4000b71012f6ee8c9c35', 'request_id': 'req-af37df42-a55f-42ba-a768-c013139604b6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:06.718732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3bb3c188ab4000b71012f6ee8c9c35', 'request_id': 'req-af37df42-a55f-42ba-a768-c013139604b6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:06.726873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3bb3c188ab4000b71012f6ee8c9c35', 'request_id': 'req-af37df42-a55f-42ba-a768-c013139604b6'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:06.738690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] The token cache is being invalidate because project ba3bb3c188ab4000b71012f6ee8c9c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:15:06.738998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:06.739631 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:06.741514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1162/2327] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:15:06 2022] DELETE /identity/v3/projects/ba3bb3c188ab4000b71012f6ee8c9c35 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:15:10.761256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4d07-f738-4434-a4de-83df4dc91188 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:10.762105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4d07-f738-4434-a4de-83df4dc91188 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:10.762105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4d07-f738-4434-a4de-83df4dc91188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:10.782956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a67d4d07-f738-4434-a4de-83df4dc91188 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:10.784195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a67d4d07-f738-4434-a4de-83df4dc91188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:10.864837 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1166/2328] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:15:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:10.880166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:10.882634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:10.975325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37df42-a55f-42ba-a768-c013139604b6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:10.981130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7835f-a452-49eb-973e-167265094a06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:10.982006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7835f-a452-49eb-973e-167265094a06 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:10.982466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7835f-a452-49eb-973e-167265094a06 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:10.982743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7835f-a452-49eb-973e-167265094a06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:10.994864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7835f-a452-49eb-973e-167265094a06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:10.996855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7835f-a452-49eb-973e-167265094a06 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:11.007558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1163/2329] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:15:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:15:20.854052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:21.012998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:24.636642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587752-2e03-4825-8d97-d86ea6a024e2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:24.637164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587752-2e03-4825-8d97-d86ea6a024e2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:24.637164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587752-2e03-4825-8d97-d86ea6a024e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:24.657900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b7587752-2e03-4825-8d97-d86ea6a024e2 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:24.659083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b7587752-2e03-4825-8d97-d86ea6a024e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:24.666871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1167/2330] 10.222.0.123 () {58 vars in 972 bytes} [Thu May 26 18:15:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:24.679983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7835f-a452-49eb-973e-167265094a06 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:24.691532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7835f-a452-49eb-973e-167265094a06 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:24.696534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:24.697257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:24.697678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:24.697957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:24.707427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:24.709054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:24.717343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1164/2331] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:15:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:15:28.166753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7587752-2e03-4825-8d97-d86ea6a024e2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:28.168713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b7587752-2e03-4825-8d97-d86ea6a024e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:28.244415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7587752-2e03-4825-8d97-d86ea6a024e2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:28.248814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:28.249678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:28.249964 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:28.250227 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] PATH_INFO: `/v3/users/ba7117463c964e83b10e381e2f2d7726` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:28.251512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7117463c964e83b10e381e2f2d7726)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:28.253441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:28.492391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7117463c964e83b10e381e2f2d7726'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:28.493046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7117463c964e83b10e381e2f2d7726'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:28.493653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7117463c964e83b10e381e2f2d7726'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:28.508195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7117463c964e83b10e381e2f2d7726'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:28.509196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:28.510708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:28.515673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7117463c964e83b10e381e2f2d7726'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:28.623787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1168/2332] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:15:28 2022] DELETE /identity/v3/users/ba7117463c964e83b10e381e2f2d7726 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:15:28.628647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389768a-5220-4be6-8fd6-381a010421f5 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:28.715257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49707c05-dbd7-4d58-abda-fd2980daaf98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:28.715590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707c05-dbd7-4d58-abda-fd2980daaf98 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:28.715945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707c05-dbd7-4d58-abda-fd2980daaf98 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:28.716226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707c05-dbd7-4d58-abda-fd2980daaf98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:28.718239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-49707c05-dbd7-4d58-abda-fd2980daaf98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:28.755237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49707c05-dbd7-4d58-abda-fd2980daaf98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:28.757898 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49707c05-dbd7-4d58-abda-fd2980daaf98 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:28.770815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1165/2333] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:15:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:28.998635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:29.000152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:29.091414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eddd14-f7b4-440a-89c9-9325275bfe87 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:29.096885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:29.097799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:29.098080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:29.098354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] PATH_INFO: `/v3/projects/b3ca1a2021114ae198da8193a6f756f2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:29.099546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ca1a2021114ae198da8193a6f756f2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:29.101549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:29.120126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:29.233121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ca1a2021114ae198da8193a6f756f2', 'request_id': 'req-58571f70-2780-4499-b39d-d09a3a10bba3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:29.336654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ca1a2021114ae198da8193a6f756f2', 'request_id': 'req-58571f70-2780-4499-b39d-d09a3a10bba3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:29.343585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ca1a2021114ae198da8193a6f756f2', 'request_id': 'req-58571f70-2780-4499-b39d-d09a3a10bba3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:29.355841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] The token cache is being invalidate because project b3ca1a2021114ae198da8193a6f756f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:15:29.356123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:29.356933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:29.358604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1169/2334] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:15:28 2022] DELETE /identity/v3/projects/b3ca1a2021114ae198da8193a6f756f2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:15:30.614129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972c47-ecbb-46de-b940-47b87bd1a0c4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:30.615027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972c47-ecbb-46de-b940-47b87bd1a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:30.615027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972c47-ecbb-46de-b940-47b87bd1a0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:30.633263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4b972c47-ecbb-46de-b940-47b87bd1a0c4 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:30.634539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4b972c47-ecbb-46de-b940-47b87bd1a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:30.690359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1166/2335] 10.222.0.123 () {58 vars in 972 bytes} [Thu May 26 18:15:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:15:30.702673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:30.704246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:30.774992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58571f70-2780-4499-b39d-d09a3a10bba3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:30.779956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e061e-1bb1-4ef6-b1c9-904dd9fd67ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:30.780634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e061e-1bb1-4ef6-b1c9-904dd9fd67ed service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:30.780902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e061e-1bb1-4ef6-b1c9-904dd9fd67ed service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:30.781202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e061e-1bb1-4ef6-b1c9-904dd9fd67ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:30.791121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e061e-1bb1-4ef6-b1c9-904dd9fd67ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:30.792800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e061e-1bb1-4ef6-b1c9-904dd9fd67ed service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:30.801994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1170/2336] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:15:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:15:36.661207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972c47-ecbb-46de-b940-47b87bd1a0c4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:36.662628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4b972c47-ecbb-46de-b940-47b87bd1a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:36.669275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:36.727859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972c47-ecbb-46de-b940-47b87bd1a0c4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:36.732233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:36.733107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:36.733385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:36.733657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] PATH_INFO: `/v3/users/055ed34782bc4c3b9e486aa3cdf138ff` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:36.734830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055ed34782bc4c3b9e486aa3cdf138ff)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:36.736788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:36.887618 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055ed34782bc4c3b9e486aa3cdf138ff'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:36.888256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055ed34782bc4c3b9e486aa3cdf138ff'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:36.888871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055ed34782bc4c3b9e486aa3cdf138ff'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:36.901157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055ed34782bc4c3b9e486aa3cdf138ff'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:36.907770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055ed34782bc4c3b9e486aa3cdf138ff'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:36.971432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1167/2337] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:15:36 2022] DELETE /identity/v3/users/055ed34782bc4c3b9e486aa3cdf138ff => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:15:36.976092 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf277a1-5cc0-45b0-8bd6-4edb663c3e88 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:36.976599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf277a1-5cc0-45b0-8bd6-4edb663c3e88 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:36.976694 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf277a1-5cc0-45b0-8bd6-4edb663c3e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:36.995300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-baf277a1-5cc0-45b0-8bd6-4edb663c3e88 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:36.996537 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-baf277a1-5cc0-45b0-8bd6-4edb663c3e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:37.058601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1171/2338] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:37.068571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:37.070170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:37.150614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d7a72-f237-45a3-a375-c3d9d01569c7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:37.154457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996bad7-4dc8-416a-b627-7f9f40c3d4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:37.155112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996bad7-4dc8-416a-b627-7f9f40c3d4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:37.155397 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996bad7-4dc8-416a-b627-7f9f40c3d4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:37.155671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996bad7-4dc8-416a-b627-7f9f40c3d4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:37.166188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996bad7-4dc8-416a-b627-7f9f40c3d4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:37.167625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996bad7-4dc8-416a-b627-7f9f40c3d4a7 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:37.178293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1168/2339] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:37.578340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf277a1-5cc0-45b0-8bd6-4edb663c3e88 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:37.579832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-baf277a1-5cc0-45b0-8bd6-4edb663c3e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:37.593465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf277a1-5cc0-45b0-8bd6-4edb663c3e88 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:37.599299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:37.600192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:37.604983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:37.604983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] PATH_INFO: `/v3/projects/37ff375421a9469bb2b275d7e16e2b2c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:37.604983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ff375421a9469bb2b275d7e16e2b2c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:37.604983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:37.687873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:37.702923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ff375421a9469bb2b275d7e16e2b2c', 'request_id': 'req-c1959a57-53cb-4efe-becf-35931d0b9d46'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:37.768023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ff375421a9469bb2b275d7e16e2b2c', 'request_id': 'req-c1959a57-53cb-4efe-becf-35931d0b9d46'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:37.775668 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ff375421a9469bb2b275d7e16e2b2c', 'request_id': 'req-c1959a57-53cb-4efe-becf-35931d0b9d46'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:37.786116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] The token cache is being invalidate because project 37ff375421a9469bb2b275d7e16e2b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:15:37.786403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:37.787031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c1959a57-53cb-4efe-becf-35931d0b9d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:15:37.788592 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1172/2340] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:15:37 2022] DELETE /identity/v3/projects/37ff375421a9469bb2b275d7e16e2b2c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:15:47.172921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=77,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:47.851251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:55.824747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8bde0-7101-49c1-8400-ea97e5f13385 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:55.825288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8bde0-7101-49c1-8400-ea97e5f13385 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:55.825288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8bde0-7101-49c1-8400-ea97e5f13385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:55.842578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-53a8bde0-7101-49c1-8400-ea97e5f13385 None None] MFA Rules not processed for user `95a7cc3020514672a7ab872cfdeabef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:55.843761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-53a8bde0-7101-49c1-8400-ea97e5f13385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:55.898310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1169/2341] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:15:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:16:05.046900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12c354-1082-4b18-8baf-d4ab58afa44f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:16:05.047459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12c354-1082-4b18-8baf-d4ab58afa44f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:16:05.047459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12c354-1082-4b18-8baf-d4ab58afa44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:16:05.066306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1a12c354-1082-4b18-8baf-d4ab58afa44f None None] MFA Rules not processed for user `09ad128756994ea0b6333d0694b840b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:16:05.067539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1a12c354-1082-4b18-8baf-d4ab58afa44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:16:05.125730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1173/2342] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:16:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:16:05.891094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=25 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:15.118659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=25 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:27.668376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86407f-73cc-4659-b857-27be77e159ab None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:16:27.668917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86407f-73cc-4659-b857-27be77e159ab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:16:27.668917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86407f-73cc-4659-b857-27be77e159ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:16:27.687751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-af86407f-73cc-4659-b857-27be77e159ab None None] MFA Rules not processed for user `ebdb2f4338f842f19f1cba1be13597c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:16:27.689322 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af86407f-73cc-4659-b857-27be77e159ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:16:27.745214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1170/2343] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:16:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:16:37.737909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=25 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:10.231970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12c354-1082-4b18-8baf-d4ab58afa44f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:10.234698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1a12c354-1082-4b18-8baf-d4ab58afa44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:10.303472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12c354-1082-4b18-8baf-d4ab58afa44f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:10.307970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:10.308861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:10.309141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:10.309411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] PATH_INFO: `/v3/users/95a7cc3020514672a7ab872cfdeabef6` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:10.310580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a7cc3020514672a7ab872cfdeabef6)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:10.312888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:10.500702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a7cc3020514672a7ab872cfdeabef6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:10.501381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a7cc3020514672a7ab872cfdeabef6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:10.501993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a7cc3020514672a7ab872cfdeabef6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:10.514628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a7cc3020514672a7ab872cfdeabef6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:10.521562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-134d6e5e-398a-4f02-a3a1-3157619c33d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a7cc3020514672a7ab872cfdeabef6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:10.619754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1174/2344] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:17:10 2022] DELETE /identity/v3/users/95a7cc3020514672a7ab872cfdeabef6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:11.109033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86407f-73cc-4659-b857-27be77e159ab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:11.123160 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86407f-73cc-4659-b857-27be77e159ab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:11.198802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:11.199682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:11.199965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:11.200236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] PATH_INFO: `/v3/projects/68c2f73b1ecd47ee8e4d9245e9710c83` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:11.207145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c2f73b1ecd47ee8e4d9245e9710c83)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:11.207145 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:11.338918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c2f73b1ecd47ee8e4d9245e9710c83', 'request_id': 'req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:11.408871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c2f73b1ecd47ee8e4d9245e9710c83', 'request_id': 'req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:11.418700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c2f73b1ecd47ee8e4d9245e9710c83', 'request_id': 'req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:11.431536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] The token cache is being invalidate because project 68c2f73b1ecd47ee8e4d9245e9710c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:17:11.431822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:11.432711 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-494ee4b8-6995-40c7-a366-6c1ec50dfd4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:11.434301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1171/2345] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:17:11 2022] DELETE /identity/v3/projects/68c2f73b1ecd47ee8e4d9245e9710c83 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:11.440231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd67e-37f3-4fbb-8fd5-f405a2489515 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:11.440778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd67e-37f3-4fbb-8fd5-f405a2489515 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:11.441103 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd67e-37f3-4fbb-8fd5-f405a2489515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:11.462654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-353bd67e-37f3-4fbb-8fd5-f405a2489515 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:11.464996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-353bd67e-37f3-4fbb-8fd5-f405a2489515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:11.550635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1175/2346] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:11.552988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031235-3345-4dee-944f-645e1534382e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:11.553422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031235-3345-4dee-944f-645e1534382e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:11.553911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031235-3345-4dee-944f-645e1534382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:11.579086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1b031235-3345-4dee-944f-645e1534382e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:11.580402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1b031235-3345-4dee-944f-645e1534382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:11.588216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1172/2347] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:11.593784 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bd67e-37f3-4fbb-8fd5-f405a2489515 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:11.605320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bd67e-37f3-4fbb-8fd5-f405a2489515 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:11.610730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:11.611394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:11.611707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:11.611983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:11.612747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:17:11.613054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:11.614682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:11.629345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1176/2348] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:17:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:17:11.633891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b031235-3345-4dee-944f-645e1534382e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:11.644033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b031235-3345-4dee-944f-645e1534382e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:11.649106 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add19e-61dc-4d3d-9989-05df7e34c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:11.649756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add19e-61dc-4d3d-9989-05df7e34c599 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:11.650034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add19e-61dc-4d3d-9989-05df7e34c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:11.650310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add19e-61dc-4d3d-9989-05df7e34c599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:11.650986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8add19e-61dc-4d3d-9989-05df7e34c599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:11.652995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8add19e-61dc-4d3d-9989-05df7e34c599 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:11.776297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1173/2349] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:17:11 2022] POST /identity/v3/projects => generated 386 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:11.781078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:11.791926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058e172-4397-4012-9565-8045ec5014a1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:11.797719 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:11.862421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52645cfe-200e-4e82-ad68-c3a79ac245cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:11.863106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52645cfe-200e-4e82-ad68-c3a79ac245cd admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:11.863388 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52645cfe-200e-4e82-ad68-c3a79ac245cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:11.863721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52645cfe-200e-4e82-ad68-c3a79ac245cd admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:11.864450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52645cfe-200e-4e82-ad68-c3a79ac245cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:11.867285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52645cfe-200e-4e82-ad68-c3a79ac245cd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:11.947501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1177/2350] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:17:11 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:11.952008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add19e-61dc-4d3d-9989-05df7e34c599 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:11.964032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add19e-61dc-4d3d-9989-05df7e34c599 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:11.969473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1b5e-2943-4a0e-9f12-f493b9a12078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:11.970184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1b5e-2943-4a0e-9f12-f493b9a12078 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:11.970459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1b5e-2943-4a0e-9f12-f493b9a12078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:11.970729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf1b5e-2943-4a0e-9f12-f493b9a12078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:11.971460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf1b5e-2943-4a0e-9f12-f493b9a12078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:11.973258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf1b5e-2943-4a0e-9f12-f493b9a12078 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:11.986894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1174/2351] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:11 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:11.994740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52645cfe-200e-4e82-ad68-c3a79ac245cd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:12.006127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52645cfe-200e-4e82-ad68-c3a79ac245cd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:12.010871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f7189-3688-4623-a2d0-9ad43afd9ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:12.011533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7189-3688-4623-a2d0-9ad43afd9ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:12.011819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7189-3688-4623-a2d0-9ad43afd9ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:12.012100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7189-3688-4623-a2d0-9ad43afd9ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:12.012897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f7189-3688-4623-a2d0-9ad43afd9ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:12.015255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f7189-3688-4623-a2d0-9ad43afd9ce2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:12.025893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1178/2352] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:11 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:12.030332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1b5e-2943-4a0e-9f12-f493b9a12078 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:12.040390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf1b5e-2943-4a0e-9f12-f493b9a12078 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:12.047052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:12.047941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:12.048223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:12.048536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] PATH_INFO: `/v3/projects/f350e4c7ac9a4ac1b43acf70f14a7ede/users/c92d6dd42d2a4f3b8972eb26522ad09c/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:12.068951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f350e4c7ac9a4ac1b43acf70f14a7ede, user_id=c92d6dd42d2a4f3b8972eb26522ad09c, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:12.071647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:12.152015 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1175/2353] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:12 2022] PUT /identity/v3/projects/f350e4c7ac9a4ac1b43acf70f14a7ede/users/c92d6dd42d2a4f3b8972eb26522ad09c/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:12.162548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e19c-ff33-46ef-af54-eec16dcd3d8f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:12.162946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e19c-ff33-46ef-af54-eec16dcd3d8f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:12.163231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e19c-ff33-46ef-af54-eec16dcd3d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:12.196183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cec9e19c-ff33-46ef-af54-eec16dcd3d8f None None] MFA Rules not processed for user `c92d6dd42d2a4f3b8972eb26522ad09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:12.197501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cec9e19c-ff33-46ef-af54-eec16dcd3d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:12.271643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1179/2354] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:12.283804 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:12.285633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:12.330350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:12.375461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b22766-0482-401c-8aee-818a545042f6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:12.381716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0cc33-a998-4a9c-b4e7-2ec49400a006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:12.382369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0cc33-a998-4a9c-b4e7-2ec49400a006 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:12.382655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0cc33-a998-4a9c-b4e7-2ec49400a006 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:12.382934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0cc33-a998-4a9c-b4e7-2ec49400a006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:12.391833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0cc33-a998-4a9c-b4e7-2ec49400a006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:12.393513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0cc33-a998-4a9c-b4e7-2ec49400a006 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:12.403260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1176/2355] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:18.903521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9e19c-ff33-46ef-af54-eec16dcd3d8f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:18.979872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9e19c-ff33-46ef-af54-eec16dcd3d8f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:18.989288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:18.989288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:18.989288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:18.989288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] PATH_INFO: `/v3/users/c92d6dd42d2a4f3b8972eb26522ad09c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:18.989756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92d6dd42d2a4f3b8972eb26522ad09c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:18.990600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:19.022756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:19.306635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92d6dd42d2a4f3b8972eb26522ad09c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:19.307291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92d6dd42d2a4f3b8972eb26522ad09c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:19.307897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92d6dd42d2a4f3b8972eb26522ad09c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:19.321778 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92d6dd42d2a4f3b8972eb26522ad09c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:19.330211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92d6dd42d2a4f3b8972eb26522ad09c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:19.412569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1180/2356] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:17:18 2022] DELETE /identity/v3/users/c92d6dd42d2a4f3b8972eb26522ad09c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:19.417024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd320-437d-4d02-a9d2-c64b51acaa33 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:19.417559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd320-437d-4d02-a9d2-c64b51acaa33 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:19.417784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fd320-437d-4d02-a9d2-c64b51acaa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:19.435881 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-334fd320-437d-4d02-a9d2-c64b51acaa33 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:19.437709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-334fd320-437d-4d02-a9d2-c64b51acaa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:19.501748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1177/2357] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:17:19.511464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:19.512934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:19.578873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f2ef-f189-4461-9ceb-e4a9067b0d6b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:19.584025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:19.584729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:19.585007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:19.585282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:19.596255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:19.597836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:19.607963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1181/2358] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:19.835639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270bd6-2521-4bb2-85f0-6b123287a5e8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:19.835931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270bd6-2521-4bb2-85f0-6b123287a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:19.836209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270bd6-2521-4bb2-85f0-6b123287a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:19.854462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2e270bd6-2521-4bb2-85f0-6b123287a5e8 None None] MFA Rules not processed for user `8c1be8ccf2f14e55a5f22d4c944c6c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:19.855667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e270bd6-2521-4bb2-85f0-6b123287a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:19.927503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1178/2359] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:20.212649 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:20.214064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:20.227525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5207613-f338-47de-a748-24e9dcc029cc service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:20.232645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:20.234088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:20.234415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:20.234751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] PATH_INFO: `/v3/projects/f350e4c7ac9a4ac1b43acf70f14a7ede` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:20.236819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f350e4c7ac9a4ac1b43acf70f14a7ede)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:20.238026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:20.382742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f350e4c7ac9a4ac1b43acf70f14a7ede', 'request_id': 'req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:20.489245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f350e4c7ac9a4ac1b43acf70f14a7ede', 'request_id': 'req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:20.497519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f350e4c7ac9a4ac1b43acf70f14a7ede', 'request_id': 'req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:20.509688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] The token cache is being invalidate because project f350e4c7ac9a4ac1b43acf70f14a7ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:17:20.509982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:20.510748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7be5976a-d1a4-4b1c-b10d-45a662c3ff9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:20.512841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1182/2360] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:17:20 2022] DELETE /identity/v3/projects/f350e4c7ac9a4ac1b43acf70f14a7ede => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:20.518156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cd213-887c-478c-9ab9-5f5418ebc3bf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:20.518653 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cd213-887c-478c-9ab9-5f5418ebc3bf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:20.518747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cd213-887c-478c-9ab9-5f5418ebc3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:20.537739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c46cd213-887c-478c-9ab9-5f5418ebc3bf None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:20.538959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c46cd213-887c-478c-9ab9-5f5418ebc3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:20.598731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:20.608140 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1179/2361] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:20.616191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de9b67-5f9e-49d5-b644-712eae27edc4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:20.616541 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de9b67-5f9e-49d5-b644-712eae27edc4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:20.616835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de9b67-5f9e-49d5-b644-712eae27edc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:20.638486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-87de9b67-5f9e-49d5-b644-712eae27edc4 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:20.640271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-87de9b67-5f9e-49d5-b644-712eae27edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:20.648578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1183/2362] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:20.652984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cd213-887c-478c-9ab9-5f5418ebc3bf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:20.663226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cd213-887c-478c-9ab9-5f5418ebc3bf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:20.667944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:20.668628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:20.668914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:20.675394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:20.675394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:17:20.675394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:20.675394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:20.684265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1180/2363] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:17:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:17:20.689336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de9b67-5f9e-49d5-b644-712eae27edc4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:20.698716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de9b67-5f9e-49d5-b644-712eae27edc4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:20.704236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cb192-296d-4473-a276-a3ddf9e7cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:20.704926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb192-296d-4473-a276-a3ddf9e7cea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:20.705206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb192-296d-4473-a276-a3ddf9e7cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:20.705481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb192-296d-4473-a276-a3ddf9e7cea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:20.706169 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cb192-296d-4473-a276-a3ddf9e7cea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:20.708268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cb192-296d-4473-a276-a3ddf9e7cea1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:20.718703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:20.821062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1184/2364] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:17:20 2022] POST /identity/v3/projects => generated 392 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:20.825418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:20.837266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50797-a816-491f-8825-890b960e63e6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:20.903527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7532-3a19-4acc-8848-0bd4ca52757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:20.904485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7532-3a19-4acc-8848-0bd4ca52757e admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:20.904768 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7532-3a19-4acc-8848-0bd4ca52757e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:20.905039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7532-3a19-4acc-8848-0bd4ca52757e admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:20.906284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf7532-3a19-4acc-8848-0bd4ca52757e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:20.910615 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf7532-3a19-4acc-8848-0bd4ca52757e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:21.021573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1181/2365] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:17:20 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:21.022800 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cb192-296d-4473-a276-a3ddf9e7cea1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:21.033826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cb192-296d-4473-a276-a3ddf9e7cea1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:21.038824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d69f52-54ea-40e4-9e6a-cfdbd1b82653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:21.039495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d69f52-54ea-40e4-9e6a-cfdbd1b82653 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:21.039776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d69f52-54ea-40e4-9e6a-cfdbd1b82653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:21.040050 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d69f52-54ea-40e4-9e6a-cfdbd1b82653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:21.040808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d69f52-54ea-40e4-9e6a-cfdbd1b82653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:21.042438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d69f52-54ea-40e4-9e6a-cfdbd1b82653 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:21.054402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1185/2366] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:21 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:21.072736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7532-3a19-4acc-8848-0bd4ca52757e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:21.083490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7532-3a19-4acc-8848-0bd4ca52757e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:21.088261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a1aa9-d00f-40d5-9536-139b6945e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:21.088956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a1aa9-d00f-40d5-9536-139b6945e899 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:21.089247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a1aa9-d00f-40d5-9536-139b6945e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:21.089526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a1aa9-d00f-40d5-9536-139b6945e899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:21.090380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a1aa9-d00f-40d5-9536-139b6945e899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:21.092011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a1aa9-d00f-40d5-9536-139b6945e899 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:21.106071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1182/2367] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:21 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:21.107339 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d69f52-54ea-40e4-9e6a-cfdbd1b82653 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:21.118260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d69f52-54ea-40e4-9e6a-cfdbd1b82653 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:21.123278 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050d9cc-abf0-410d-8566-e121158ba807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:21.124238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050d9cc-abf0-410d-8566-e121158ba807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:21.124562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050d9cc-abf0-410d-8566-e121158ba807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:21.124884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050d9cc-abf0-410d-8566-e121158ba807 admin admin] PATH_INFO: `/v3/projects/0b069e68ce0b45e1a29904c57164061c/users/59b29184ca8c411484434b6d74ac459e/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:21.141517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050d9cc-abf0-410d-8566-e121158ba807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b069e68ce0b45e1a29904c57164061c, user_id=59b29184ca8c411484434b6d74ac459e, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:21.144345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050d9cc-abf0-410d-8566-e121158ba807 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:21.406221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1186/2368] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:21 2022] PUT /identity/v3/projects/0b069e68ce0b45e1a29904c57164061c/users/59b29184ca8c411484434b6d74ac459e/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:21.422343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44336-a5b6-450e-8307-d878797d74fd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:21.422701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44336-a5b6-450e-8307-d878797d74fd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:21.423127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44336-a5b6-450e-8307-d878797d74fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:21.455688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b1a44336-a5b6-450e-8307-d878797d74fd None None] MFA Rules not processed for user `59b29184ca8c411484434b6d74ac459e`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:21.457165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b1a44336-a5b6-450e-8307-d878797d74fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:21.533162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1183/2369] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:21.537860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050d9cc-abf0-410d-8566-e121158ba807 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:21.611007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050d9cc-abf0-410d-8566-e121158ba807 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:21.615726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5fe6f-64f6-4098-96e1-7b0222c2374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:21.616426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5fe6f-64f6-4098-96e1-7b0222c2374e admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:21.616710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5fe6f-64f6-4098-96e1-7b0222c2374e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:21.616989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5fe6f-64f6-4098-96e1-7b0222c2374e admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:21.617682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5fe6f-64f6-4098-96e1-7b0222c2374e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:21.619603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5fe6f-64f6-4098-96e1-7b0222c2374e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:21.752788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1187/2370] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:17:21 2022] POST /identity/v3/projects => generated 394 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:21.754739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a44336-a5b6-450e-8307-d878797d74fd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:21.771425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a44336-a5b6-450e-8307-d878797d74fd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:21.826847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:21.836918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1244-7cec-4d89-abe3-2c9fd0209986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:21.837582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1244-7cec-4d89-abe3-2c9fd0209986 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:21.838055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1244-7cec-4d89-abe3-2c9fd0209986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:21.838335 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1244-7cec-4d89-abe3-2c9fd0209986 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:21.839151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1244-7cec-4d89-abe3-2c9fd0209986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:21.841120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1244-7cec-4d89-abe3-2c9fd0209986 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:22.027284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1184/2371] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:17:21 2022] POST /identity/v3/users => generated 304 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:22.032432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5fe6f-64f6-4098-96e1-7b0222c2374e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:22.043389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5fe6f-64f6-4098-96e1-7b0222c2374e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:22.048740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd086d3e-837e-454a-9061-33b33315a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:22.049423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd086d3e-837e-454a-9061-33b33315a9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:22.049708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd086d3e-837e-454a-9061-33b33315a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:22.049984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd086d3e-837e-454a-9061-33b33315a9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:22.050718 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd086d3e-837e-454a-9061-33b33315a9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:22.052365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd086d3e-837e-454a-9061-33b33315a9a5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:22.068969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1188/2372] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:22 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:22.070327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1244-7cec-4d89-abe3-2c9fd0209986 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:22.081563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1244-7cec-4d89-abe3-2c9fd0209986 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:22.086188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbdc92-a030-4f99-8318-02d0cf6ed445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:22.087081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdc92-a030-4f99-8318-02d0cf6ed445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:22.087366 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdc92-a030-4f99-8318-02d0cf6ed445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:22.087644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdc92-a030-4f99-8318-02d0cf6ed445 admin admin] PATH_INFO: `/v3/projects/a53950d1b8634455aa5e1777cf6ec25f/users/83afee3b0ed24137a8da0a1e028ff139/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:22.104420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbdc92-a030-4f99-8318-02d0cf6ed445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53950d1b8634455aa5e1777cf6ec25f, user_id=83afee3b0ed24137a8da0a1e028ff139, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:22.107143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbdc92-a030-4f99-8318-02d0cf6ed445 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:22.329713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1185/2373] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:22 2022] PUT /identity/v3/projects/a53950d1b8634455aa5e1777cf6ec25f/users/83afee3b0ed24137a8da0a1e028ff139/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:17:22.334923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd086d3e-837e-454a-9061-33b33315a9a5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:22.344584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd086d3e-837e-454a-9061-33b33315a9a5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:22.406255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da2c91-5b82-47da-9e14-534625f37d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:22.407068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da2c91-5b82-47da-9e14-534625f37d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:22.418007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da2c91-5b82-47da-9e14-534625f37d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:22.418007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da2c91-5b82-47da-9e14-534625f37d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:22.418007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da2c91-5b82-47da-9e14-534625f37d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:22.418007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da2c91-5b82-47da-9e14-534625f37d9b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:22.425139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1189/2374] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:22 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:22.426431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbdc92-a030-4f99-8318-02d0cf6ed445 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:22.436936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbdc92-a030-4f99-8318-02d0cf6ed445 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:22.441538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:22.442328 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:22.442609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:22.442885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] PATH_INFO: `/v3/projects/a53950d1b8634455aa5e1777cf6ec25f/users/83afee3b0ed24137a8da0a1e028ff139/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:22.444928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53950d1b8634455aa5e1777cf6ec25f, user_id=83afee3b0ed24137a8da0a1e028ff139, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:22.447597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:22.458307 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1186/2375] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:22 2022] PUT /identity/v3/projects/a53950d1b8634455aa5e1777cf6ec25f/users/83afee3b0ed24137a8da0a1e028ff139/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:22.469011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0567-9ce2-4791-8399-a2139aa52bec None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:22.469306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0567-9ce2-4791-8399-a2139aa52bec None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:22.469581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0567-9ce2-4791-8399-a2139aa52bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:22.496868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-098f0567-9ce2-4791-8399-a2139aa52bec None None] MFA Rules not processed for user `83afee3b0ed24137a8da0a1e028ff139`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:22.498206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-098f0567-9ce2-4791-8399-a2139aa52bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:22.573024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1190/2376] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:22.584787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:22.586551 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:22.643609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d314d9-2c18-47ef-ad77-8e0f57fc6b06 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:22.647219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd9737-1489-4551-a418-44073835b832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:22.647856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd9737-1489-4551-a418-44073835b832 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:22.648141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd9737-1489-4551-a418-44073835b832 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:22.648452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd9737-1489-4551-a418-44073835b832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:22.658306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd9737-1489-4551-a418-44073835b832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:22.659950 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd9737-1489-4551-a418-44073835b832 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:22.670282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1187/2377] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:22.715647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f0567-9ce2-4791-8399-a2139aa52bec None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:22.717365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-098f0567-9ce2-4791-8399-a2139aa52bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:22.731728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f0567-9ce2-4791-8399-a2139aa52bec None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:22.735541 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:22.736188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:22.736489 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:22.736764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:22.802067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:22.803553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:22.817117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1191/2378] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:23.053155 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadf3a6-2db2-44d5-8d14-e3c053f06249 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:23.053417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadf3a6-2db2-44d5-8d14-e3c053f06249 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:23.053695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadf3a6-2db2-44d5-8d14-e3c053f06249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:23.071554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cfadf3a6-2db2-44d5-8d14-e3c053f06249 None None] MFA Rules not processed for user `09ad128756994ea0b6333d0694b840b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:23.072797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cfadf3a6-2db2-44d5-8d14-e3c053f06249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:23.131057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1188/2379] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:23.429799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:25.480078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:25.481684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:25.538911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef2a8c-bb0d-48cb-a2c5-6cc88084cbd6 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:25.542602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:25.543234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:25.543509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:25.543775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:25.545513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:25.603807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:25.617009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:25.621299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:25.629536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1192/2380] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:26.177808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadf3a6-2db2-44d5-8d14-e3c053f06249 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:26.180657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cfadf3a6-2db2-44d5-8d14-e3c053f06249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:26.196800 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadf3a6-2db2-44d5-8d14-e3c053f06249 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:26.201995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69766e8a-6fbe-42a4-9cd0-6ecc1fd6c6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:26.203223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69766e8a-6fbe-42a4-9cd0-6ecc1fd6c6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:26.203494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69766e8a-6fbe-42a4-9cd0-6ecc1fd6c6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:26.203765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69766e8a-6fbe-42a4-9cd0-6ecc1fd6c6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:26.206405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-69766e8a-6fbe-42a4-9cd0-6ecc1fd6c6e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:26.235093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69766e8a-6fbe-42a4-9cd0-6ecc1fd6c6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:26.237477 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69766e8a-6fbe-42a4-9cd0-6ecc1fd6c6e5 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:26.252368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1189/2381] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:29.246179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:29.328639 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a28de-c1aa-45b8-8e7e-03ae9bfbe4d0 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:29.333481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:29.334331 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:29.334686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:29.334905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] PATH_INFO: `/v3/users/59b29184ca8c411484434b6d74ac459e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:29.336094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b29184ca8c411484434b6d74ac459e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:29.338076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:29.621822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b29184ca8c411484434b6d74ac459e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:29.622540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b29184ca8c411484434b6d74ac459e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:29.623208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b29184ca8c411484434b6d74ac459e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:29.637760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b29184ca8c411484434b6d74ac459e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:29.645455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b29184ca8c411484434b6d74ac459e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:29.775443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1193/2382] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:17:29 2022] DELETE /identity/v3/users/59b29184ca8c411484434b6d74ac459e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:29.780035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8b313-ec2b-4bc9-ba72-26100c62f481 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:29.791271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8b313-ec2b-4bc9-ba72-26100c62f481 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:29.791271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8b313-ec2b-4bc9-ba72-26100c62f481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:29.805214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-43e8b313-ec2b-4bc9-ba72-26100c62f481 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:29.806892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-43e8b313-ec2b-4bc9-ba72-26100c62f481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:29.845370 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:29.877324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1190/2383] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:29.886344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:29.887816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:29.957286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfc51-981e-4cf5-966d-9ec879c28cd0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:29.961271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455809-be46-4e73-8b0a-f2f8646eb656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:29.962041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455809-be46-4e73-8b0a-f2f8646eb656 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:29.962390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455809-be46-4e73-8b0a-f2f8646eb656 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:29.962799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455809-be46-4e73-8b0a-f2f8646eb656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:29.975379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455809-be46-4e73-8b0a-f2f8646eb656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:29.977322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455809-be46-4e73-8b0a-f2f8646eb656 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:29.989767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1194/2384] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:30.578792 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8b313-ec2b-4bc9-ba72-26100c62f481 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:30.580326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-43e8b313-ec2b-4bc9-ba72-26100c62f481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:30.595035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8b313-ec2b-4bc9-ba72-26100c62f481 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:30.600849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:30.602074 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:30.602547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:30.602823 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] PATH_INFO: `/v3/projects/0b069e68ce0b45e1a29904c57164061c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:30.604249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b069e68ce0b45e1a29904c57164061c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:30.606846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:30.753396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b069e68ce0b45e1a29904c57164061c', 'request_id': 'req-375e3107-ec70-4762-8721-47c550eaccc4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:30.843919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b069e68ce0b45e1a29904c57164061c', 'request_id': 'req-375e3107-ec70-4762-8721-47c550eaccc4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:30.851702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b069e68ce0b45e1a29904c57164061c', 'request_id': 'req-375e3107-ec70-4762-8721-47c550eaccc4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:30.865717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] The token cache is being invalidate because project 0b069e68ce0b45e1a29904c57164061c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:17:30.866010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:30.866883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:30.872552 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1191/2385] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:17:30 2022] DELETE /identity/v3/projects/0b069e68ce0b45e1a29904c57164061c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:30.873378 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455809-be46-4e73-8b0a-f2f8646eb656 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:30.884433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455809-be46-4e73-8b0a-f2f8646eb656 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:30.895734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:30.971828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:30.972823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:30.973052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:30.973315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] PATH_INFO: `/v3/users/83afee3b0ed24137a8da0a1e028ff139` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:30.980346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83afee3b0ed24137a8da0a1e028ff139)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:30.983188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:31.293527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83afee3b0ed24137a8da0a1e028ff139'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:31.294179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83afee3b0ed24137a8da0a1e028ff139'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:31.294923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83afee3b0ed24137a8da0a1e028ff139'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:31.308580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83afee3b0ed24137a8da0a1e028ff139'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:31.318686 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82922133-f65d-4916-809f-1b7f68d7913c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83afee3b0ed24137a8da0a1e028ff139'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:31.456225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1195/2386] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:17:30 2022] DELETE /identity/v3/users/83afee3b0ed24137a8da0a1e028ff139 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:17:31.985352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:31.986877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:32.001336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3107-ec70-4762-8721-47c550eaccc4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:32.067836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:32.068868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:32.069257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:32.069826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] PATH_INFO: `/v3/projects/a53950d1b8634455aa5e1777cf6ec25f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:32.071323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53950d1b8634455aa5e1777cf6ec25f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:32.073566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:32.210840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53950d1b8634455aa5e1777cf6ec25f', 'request_id': 'req-8c01778f-9843-4b5b-8149-50f644298395'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:32.313008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53950d1b8634455aa5e1777cf6ec25f', 'request_id': 'req-8c01778f-9843-4b5b-8149-50f644298395'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:32.321200 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53950d1b8634455aa5e1777cf6ec25f', 'request_id': 'req-8c01778f-9843-4b5b-8149-50f644298395'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:32.326085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:32.334667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] The token cache is being invalidate because project a53950d1b8634455aa5e1777cf6ec25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:17:32.334982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:32.335642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8c01778f-9843-4b5b-8149-50f644298395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:32.337230 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1192/2387] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:17:31 2022] DELETE /identity/v3/projects/a53950d1b8634455aa5e1777cf6ec25f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:32.342226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc8422-45e4-4c0a-a7f9-4d9ec4956a94 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:32.342751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc8422-45e4-4c0a-a7f9-4d9ec4956a94 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:32.342989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc8422-45e4-4c0a-a7f9-4d9ec4956a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:32.363546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-82fc8422-45e4-4c0a-a7f9-4d9ec4956a94 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:32.364983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-82fc8422-45e4-4c0a-a7f9-4d9ec4956a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:32.427518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1196/2388] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:17:32.436251 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e472-48d6-4fe6-96c9-8cc4257d29a8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:32.436605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e472-48d6-4fe6-96c9-8cc4257d29a8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:32.436927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e472-48d6-4fe6-96c9-8cc4257d29a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:32.501726 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f1b6e472-48d6-4fe6-96c9-8cc4257d29a8 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:32.503011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f1b6e472-48d6-4fe6-96c9-8cc4257d29a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:32.511746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1193/2389] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:32.516342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc8422-45e4-4c0a-a7f9-4d9ec4956a94 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:32.526125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc8422-45e4-4c0a-a7f9-4d9ec4956a94 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:32.534120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:32.535007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:32.535368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:32.535910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:32.536675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:17:32.539458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:32.539458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:32.555645 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1197/2390] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:17:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:17:32.557154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e472-48d6-4fe6-96c9-8cc4257d29a8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:32.566956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e472-48d6-4fe6-96c9-8cc4257d29a8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:32.571999 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55bd2c-915e-4c84-b264-9caa96195349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:32.573012 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55bd2c-915e-4c84-b264-9caa96195349 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:32.573394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55bd2c-915e-4c84-b264-9caa96195349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:32.574115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55bd2c-915e-4c84-b264-9caa96195349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:32.574871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55bd2c-915e-4c84-b264-9caa96195349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:32.576947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55bd2c-915e-4c84-b264-9caa96195349 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:32.739797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1194/2391] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:17:32 2022] POST /identity/v3/projects => generated 384 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:17:32.744212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:32.756112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ea60-0544-4d22-874c-03d623ed5343 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:32.844202 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8048d93-51f8-4c77-b2de-b51145e87f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:32.844993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8048d93-51f8-4c77-b2de-b51145e87f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:32.845277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8048d93-51f8-4c77-b2de-b51145e87f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:32.845580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8048d93-51f8-4c77-b2de-b51145e87f5b admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:32.846432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8048d93-51f8-4c77-b2de-b51145e87f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:32.848451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8048d93-51f8-4c77-b2de-b51145e87f5b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:32.962023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1198/2392] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:17:32 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:32.963575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55bd2c-915e-4c84-b264-9caa96195349 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:32.974299 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55bd2c-915e-4c84-b264-9caa96195349 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:32.979106 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd29fc-981c-4d4c-9ea2-62fa8e0751d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:32.981544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:32.982359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd29fc-981c-4d4c-9ea2-62fa8e0751d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:32.982674 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd29fc-981c-4d4c-9ea2-62fa8e0751d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:32.982955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd29fc-981c-4d4c-9ea2-62fa8e0751d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:32.983758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd29fc-981c-4d4c-9ea2-62fa8e0751d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:32.985525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd29fc-981c-4d4c-9ea2-62fa8e0751d8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:33.003093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1195/2393] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:32 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:33.006053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8048d93-51f8-4c77-b2de-b51145e87f5b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:33.017565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8048d93-51f8-4c77-b2de-b51145e87f5b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:33.022309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42daeb7f-001a-4f26-9e57-0cd4649265d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:33.022983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daeb7f-001a-4f26-9e57-0cd4649265d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:33.023267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daeb7f-001a-4f26-9e57-0cd4649265d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:33.023972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daeb7f-001a-4f26-9e57-0cd4649265d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:33.024295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42daeb7f-001a-4f26-9e57-0cd4649265d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:33.025965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42daeb7f-001a-4f26-9e57-0cd4649265d3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:33.037288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1199/2394] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:33 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:33.041474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd29fc-981c-4d4c-9ea2-62fa8e0751d8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:33.054875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd29fc-981c-4d4c-9ea2-62fa8e0751d8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:33.059916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc8645-89b2-4760-ac5b-8de5bec1386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:33.061312 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8645-89b2-4760-ac5b-8de5bec1386f admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:33.062426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8645-89b2-4760-ac5b-8de5bec1386f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:33.062849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc8645-89b2-4760-ac5b-8de5bec1386f admin admin] PATH_INFO: `/v3/projects/c8b4fe366895483ab9ccdebd9f6fb18f/users/97926bf47fe0483984aaee85e52806bd/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:33.079115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc8645-89b2-4760-ac5b-8de5bec1386f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b4fe366895483ab9ccdebd9f6fb18f, user_id=97926bf47fe0483984aaee85e52806bd, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:33.082499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc8645-89b2-4760-ac5b-8de5bec1386f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:33.159206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1196/2395] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:33 2022] PUT /identity/v3/projects/c8b4fe366895483ab9ccdebd9f6fb18f/users/97926bf47fe0483984aaee85e52806bd/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:17:33.169977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f66ab-1a3d-4dcb-877e-5551f3caa7e7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:33.170271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f66ab-1a3d-4dcb-877e-5551f3caa7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:33.170549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f66ab-1a3d-4dcb-877e-5551f3caa7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:33.203562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-350f66ab-1a3d-4dcb-877e-5551f3caa7e7 None None] MFA Rules not processed for user `97926bf47fe0483984aaee85e52806bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:33.205035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-350f66ab-1a3d-4dcb-877e-5551f3caa7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:33.281801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1200/2396] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:33.286391 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc8645-89b2-4760-ac5b-8de5bec1386f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:33.355244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc8645-89b2-4760-ac5b-8de5bec1386f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:33.361410 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed70bc8-e558-44c7-9ced-083a94750b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:33.362100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed70bc8-e558-44c7-9ced-083a94750b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:33.362383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed70bc8-e558-44c7-9ced-083a94750b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:33.362661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed70bc8-e558-44c7-9ced-083a94750b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:33.363378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed70bc8-e558-44c7-9ced-083a94750b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:33.365413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed70bc8-e558-44c7-9ced-083a94750b96 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:33.522360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1197/2397] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:17:33 2022] POST /identity/v3/projects => generated 384 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:33.526211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f66ab-1a3d-4dcb-877e-5551f3caa7e7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:33.538741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f66ab-1a3d-4dcb-877e-5551f3caa7e7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:33.597902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547981a-351a-464e-9c58-31e310c5e4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:33.598579 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547981a-351a-464e-9c58-31e310c5e4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:33.598863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547981a-351a-464e-9c58-31e310c5e4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:33.599140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547981a-351a-464e-9c58-31e310c5e4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:33.599834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547981a-351a-464e-9c58-31e310c5e4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:33.601796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547981a-351a-464e-9c58-31e310c5e4b1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:33.737126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1201/2398] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:17:33 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:33.741199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed70bc8-e558-44c7-9ced-083a94750b96 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:33.751782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed70bc8-e558-44c7-9ced-083a94750b96 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:33.756387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d9084-f671-4998-a8bc-4ddcf0ee9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:33.757040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9084-f671-4998-a8bc-4ddcf0ee9923 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:33.757325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9084-f671-4998-a8bc-4ddcf0ee9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:33.757607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9084-f671-4998-a8bc-4ddcf0ee9923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:33.758327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d9084-f671-4998-a8bc-4ddcf0ee9923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:33.759949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d9084-f671-4998-a8bc-4ddcf0ee9923 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:33.771437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1198/2399] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:33 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:33.775692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547981a-351a-464e-9c58-31e310c5e4b1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:33.786524 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547981a-351a-464e-9c58-31e310c5e4b1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:33.791457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16658fd1-0f18-4979-a9ec-d670ddb74b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:33.792377 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16658fd1-0f18-4979-a9ec-d670ddb74b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:33.792701 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16658fd1-0f18-4979-a9ec-d670ddb74b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:33.792921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16658fd1-0f18-4979-a9ec-d670ddb74b70 admin admin] PATH_INFO: `/v3/projects/5ec17b439a994e9db05a12bef1580e93/users/ec38943e80fb4009952aa9511990f9f0/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:33.808536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16658fd1-0f18-4979-a9ec-d670ddb74b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec17b439a994e9db05a12bef1580e93, user_id=ec38943e80fb4009952aa9511990f9f0, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:33.811222 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16658fd1-0f18-4979-a9ec-d670ddb74b70 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:33.891842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1202/2400] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:33 2022] PUT /identity/v3/projects/5ec17b439a994e9db05a12bef1580e93/users/ec38943e80fb4009952aa9511990f9f0/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:33.896136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d9084-f671-4998-a8bc-4ddcf0ee9923 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:33.907390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d9084-f671-4998-a8bc-4ddcf0ee9923 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:33.967393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e7816-7e37-401b-a6a5-7d8b682c61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:33.970832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7816-7e37-401b-a6a5-7d8b682c61e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:33.971092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7816-7e37-401b-a6a5-7d8b682c61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:33.971374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7816-7e37-401b-a6a5-7d8b682c61e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:33.972124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7816-7e37-401b-a6a5-7d8b682c61e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:33.973809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7816-7e37-401b-a6a5-7d8b682c61e1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:33.987761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1199/2401] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:33 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:33.988966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16658fd1-0f18-4979-a9ec-d670ddb74b70 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.007324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16658fd1-0f18-4979-a9ec-d670ddb74b70 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.012507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.014247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.014247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.014247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] PATH_INFO: `/v3/projects/5ec17b439a994e9db05a12bef1580e93/users/ec38943e80fb4009952aa9511990f9f0/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.017536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec17b439a994e9db05a12bef1580e93, user_id=ec38943e80fb4009952aa9511990f9f0, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.020588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.036571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1203/2402] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:33 2022] PUT /identity/v3/projects/5ec17b439a994e9db05a12bef1580e93/users/ec38943e80fb4009952aa9511990f9f0/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:34.048024 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924cd0-f4bc-45ee-9ccc-94fda19e524a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.048346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924cd0-f4bc-45ee-9ccc-94fda19e524a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.048621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924cd0-f4bc-45ee-9ccc-94fda19e524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.080884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-11924cd0-f4bc-45ee-9ccc-94fda19e524a None None] MFA Rules not processed for user `ec38943e80fb4009952aa9511990f9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:34.082415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-11924cd0-f4bc-45ee-9ccc-94fda19e524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:34.152868 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1200/2403] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:34.165870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.167578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:34.182560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:34.230556 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befc61d-0211-4019-b6a9-c38e98aec2f5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.234463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf1505-db2b-48f9-b7ea-7d1290bd2c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.235113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1505-db2b-48f9-b7ea-7d1290bd2c30 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.235394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1505-db2b-48f9-b7ea-7d1290bd2c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.235665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1505-db2b-48f9-b7ea-7d1290bd2c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.245622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf1505-db2b-48f9-b7ea-7d1290bd2c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.247349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf1505-db2b-48f9-b7ea-7d1290bd2c30 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.263368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1204/2404] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:34.322859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11924cd0-f4bc-45ee-9ccc-94fda19e524a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.324276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-11924cd0-f4bc-45ee-9ccc-94fda19e524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:34.370501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf1505-db2b-48f9-b7ea-7d1290bd2c30 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.380740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf1505-db2b-48f9-b7ea-7d1290bd2c30 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.384497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42a155-88f8-453a-b90e-5a323d895858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.385131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a155-88f8-453a-b90e-5a323d895858 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.385409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a155-88f8-453a-b90e-5a323d895858 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.385678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a155-88f8-453a-b90e-5a323d895858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.407068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11924cd0-f4bc-45ee-9ccc-94fda19e524a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.412837 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a13e8-a83a-4b55-8bf8-c0e175134207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.413958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a13e8-a83a-4b55-8bf8-c0e175134207 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.414243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a13e8-a83a-4b55-8bf8-c0e175134207 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.414518 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a13e8-a83a-4b55-8bf8-c0e175134207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.416365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f19a13e8-a83a-4b55-8bf8-c0e175134207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:34.450231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42a155-88f8-453a-b90e-5a323d895858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.451714 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42a155-88f8-453a-b90e-5a323d895858 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.463047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1205/2405] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:34.487483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a13e8-a83a-4b55-8bf8-c0e175134207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.489278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a13e8-a83a-4b55-8bf8-c0e175134207 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.500997 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1201/2406] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:34.645548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:38.030375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42a155-88f8-453a-b90e-5a323d895858 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:38.096745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42a155-88f8-453a-b90e-5a323d895858 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:38.101354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:38.104767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:38.104767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:38.104767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] PATH_INFO: `/v3/users/97926bf47fe0483984aaee85e52806bd` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:38.104767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97926bf47fe0483984aaee85e52806bd)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:38.106045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:38.134117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:38.310591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97926bf47fe0483984aaee85e52806bd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:38.311326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97926bf47fe0483984aaee85e52806bd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:38.311944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97926bf47fe0483984aaee85e52806bd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:38.323955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97926bf47fe0483984aaee85e52806bd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:38.331704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97926bf47fe0483984aaee85e52806bd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:38.476571 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1206/2407] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:17:38 2022] DELETE /identity/v3/users/97926bf47fe0483984aaee85e52806bd => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:38.481389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e2602-89c1-413a-bf17-dd06fa808201 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:38.481866 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e2602-89c1-413a-bf17-dd06fa808201 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:38.481866 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e2602-89c1-413a-bf17-dd06fa808201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:38.503979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-eb7e2602-89c1-413a-bf17-dd06fa808201 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:38.506006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eb7e2602-89c1-413a-bf17-dd06fa808201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:38.527045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:38.574504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1202/2408] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:38.587320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:38.589335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:38.652652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649025c2-596e-4f45-aaa5-59998cd46191 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:38.657013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c8da5-aea5-4749-80ea-10849057769c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:38.657666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c8da5-aea5-4749-80ea-10849057769c service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:38.657949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c8da5-aea5-4749-80ea-10849057769c service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:38.658225 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c8da5-aea5-4749-80ea-10849057769c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:38.667782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c8da5-aea5-4749-80ea-10849057769c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:38.669318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c8da5-aea5-4749-80ea-10849057769c service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:38.679994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1207/2409] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:39.196716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e2602-89c1-413a-bf17-dd06fa808201 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:39.198147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eb7e2602-89c1-413a-bf17-dd06fa808201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:39.210565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e2602-89c1-413a-bf17-dd06fa808201 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:39.219417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:39.222284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:39.222761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:39.223229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] PATH_INFO: `/v3/projects/c8b4fe366895483ab9ccdebd9f6fb18f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:39.225425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b4fe366895483ab9ccdebd9f6fb18f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:39.229411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:39.494220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b4fe366895483ab9ccdebd9f6fb18f', 'request_id': 'req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:39.606708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b4fe366895483ab9ccdebd9f6fb18f', 'request_id': 'req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:39.614815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b4fe366895483ab9ccdebd9f6fb18f', 'request_id': 'req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:39.632822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] The token cache is being invalidate because project c8b4fe366895483ab9ccdebd9f6fb18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:17:39.633257 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:39.634603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:39.639659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1203/2410] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:17:39 2022] DELETE /identity/v3/projects/c8b4fe366895483ab9ccdebd9f6fb18f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:39.641449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c8da5-aea5-4749-80ea-10849057769c service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:39.653087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c8da5-aea5-4749-80ea-10849057769c service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:39.728183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:39.729355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:39.729711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:39.730098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] PATH_INFO: `/v3/users/ec38943e80fb4009952aa9511990f9f0` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:39.731674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec38943e80fb4009952aa9511990f9f0)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:39.734753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:40.038942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec38943e80fb4009952aa9511990f9f0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:40.039708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec38943e80fb4009952aa9511990f9f0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:40.040455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec38943e80fb4009952aa9511990f9f0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:40.056868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec38943e80fb4009952aa9511990f9f0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:40.064542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b0cd9425-649b-4910-aed8-8a58925d6041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec38943e80fb4009952aa9511990f9f0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:40.166532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1208/2411] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:17:39 2022] DELETE /identity/v3/users/ec38943e80fb4009952aa9511990f9f0 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:40.315761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:40.668586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:40.670116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:40.683752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa4b7c-cf5a-42fa-9253-c07ab6b2034f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:40.752186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:40.753083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:40.753426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:40.753706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] PATH_INFO: `/v3/projects/5ec17b439a994e9db05a12bef1580e93` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:40.754897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec17b439a994e9db05a12bef1580e93)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:40.756885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:40.919558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:40.923181 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec17b439a994e9db05a12bef1580e93', 'request_id': 'req-8153513c-90d0-4c15-8c6e-7d594de183af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:41.089875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec17b439a994e9db05a12bef1580e93', 'request_id': 'req-8153513c-90d0-4c15-8c6e-7d594de183af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:41.097386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec17b439a994e9db05a12bef1580e93', 'request_id': 'req-8153513c-90d0-4c15-8c6e-7d594de183af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:41.107874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] The token cache is being invalidate because project 5ec17b439a994e9db05a12bef1580e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:17:41.108161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:41.108825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8153513c-90d0-4c15-8c6e-7d594de183af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:41.110886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1204/2412] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:17:40 2022] DELETE /identity/v3/projects/5ec17b439a994e9db05a12bef1580e93 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:41.115863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac5bdc-72dd-4134-a8f0-26cc41d553ca None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.116374 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac5bdc-72dd-4134-a8f0-26cc41d553ca None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.116470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac5bdc-72dd-4134-a8f0-26cc41d553ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:41.135983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-15ac5bdc-72dd-4134-a8f0-26cc41d553ca None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:41.137211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-15ac5bdc-72dd-4134-a8f0-26cc41d553ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:41.198350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1209/2413] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:41.208045 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37604352-ede8-4647-80a0-da76c6e23c16 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.208351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37604352-ede8-4647-80a0-da76c6e23c16 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.208632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37604352-ede8-4647-80a0-da76c6e23c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:41.228616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-37604352-ede8-4647-80a0-da76c6e23c16 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:41.229809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-37604352-ede8-4647-80a0-da76c6e23c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:41.238596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1205/2414] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:41.242540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac5bdc-72dd-4134-a8f0-26cc41d553ca None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:41.252908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac5bdc-72dd-4134-a8f0-26cc41d553ca None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:41.257341 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:41.257981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.258258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.258553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:41.259304 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:17:41.259608 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:41.261769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:41.273766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1210/2415] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:17:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:17:41.278199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37604352-ede8-4647-80a0-da76c6e23c16 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:41.287779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37604352-ede8-4647-80a0-da76c6e23c16 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:41.292452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e491a-540a-498f-a9ce-d840b9547a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:41.293108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e491a-540a-498f-a9ce-d840b9547a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.293389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e491a-540a-498f-a9ce-d840b9547a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.293664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e491a-540a-498f-a9ce-d840b9547a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:41.294357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e491a-540a-498f-a9ce-d840b9547a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:41.296330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e491a-540a-498f-a9ce-d840b9547a5e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:41.462681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1206/2416] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:17:41 2022] POST /identity/v3/projects => generated 362 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:41.467228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:41.477768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41d0a2-cb93-4e11-99c2-0baa96b3b297 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:41.543257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acf887-39df-4f1e-a15a-9be6284f7db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:41.544012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf887-39df-4f1e-a15a-9be6284f7db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.544767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf887-39df-4f1e-a15a-9be6284f7db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.545059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf887-39df-4f1e-a15a-9be6284f7db8 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:41.545747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acf887-39df-4f1e-a15a-9be6284f7db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:41.548692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acf887-39df-4f1e-a15a-9be6284f7db8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:41.726188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1211/2417] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:17:41 2022] POST /identity/v3/users => generated 282 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:17:41.729694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e491a-540a-498f-a9ce-d840b9547a5e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:41.740796 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e491a-540a-498f-a9ce-d840b9547a5e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:41.745297 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb280-ea24-40e6-9eb5-dc2042cca206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:41.745942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb280-ea24-40e6-9eb5-dc2042cca206 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.746225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb280-ea24-40e6-9eb5-dc2042cca206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.746502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb280-ea24-40e6-9eb5-dc2042cca206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:41.747243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abb280-ea24-40e6-9eb5-dc2042cca206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:41.748889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abb280-ea24-40e6-9eb5-dc2042cca206 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:41.759714 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1207/2418] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:41 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:41.763620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acf887-39df-4f1e-a15a-9be6284f7db8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:41.774479 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acf887-39df-4f1e-a15a-9be6284f7db8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:41.779139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa2a3a-07bb-4f62-8c1e-dd3f1174754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:41.779798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa2a3a-07bb-4f62-8c1e-dd3f1174754e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.780080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa2a3a-07bb-4f62-8c1e-dd3f1174754e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.780401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa2a3a-07bb-4f62-8c1e-dd3f1174754e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:41.781126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa2a3a-07bb-4f62-8c1e-dd3f1174754e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:41.783305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa2a3a-07bb-4f62-8c1e-dd3f1174754e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:41.793675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1212/2419] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:41 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:17:41.798913 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb280-ea24-40e6-9eb5-dc2042cca206 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:41.808882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb280-ea24-40e6-9eb5-dc2042cca206 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:41.813994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:41.814862 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.815146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.815422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] PATH_INFO: `/v3/projects/be88cb651336446283fe64175cf0d9cc/users/55ba9875542b403ab5780d3759e16cb9/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:41.831776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=be88cb651336446283fe64175cf0d9cc, user_id=55ba9875542b403ab5780d3759e16cb9, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:41.834549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:41.961033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1208/2420] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:41 2022] PUT /identity/v3/projects/be88cb651336446283fe64175cf0d9cc/users/55ba9875542b403ab5780d3759e16cb9/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:17:41.972074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315296a3-bbdf-4c2a-86d1-2b9b939efaf6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:41.972468 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315296a3-bbdf-4c2a-86d1-2b9b939efaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:41.972791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315296a3-bbdf-4c2a-86d1-2b9b939efaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:42.001914 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-315296a3-bbdf-4c2a-86d1-2b9b939efaf6 None None] MFA Rules not processed for user `55ba9875542b403ab5780d3759e16cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:42.003125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-315296a3-bbdf-4c2a-86d1-2b9b939efaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:42.020568 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:42.069113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1213/2421] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:42.101613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:42.103337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:42.161990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8b995-3a54-41e4-871c-5d07c1c655ca admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:42.165875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83ad24-56c3-4a91-9951-0c8399bc0cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:42.166516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83ad24-56c3-4a91-9951-0c8399bc0cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:42.166795 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83ad24-56c3-4a91-9951-0c8399bc0cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:42.167069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83ad24-56c3-4a91-9951-0c8399bc0cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:42.176928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83ad24-56c3-4a91-9951-0c8399bc0cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:42.179602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83ad24-56c3-4a91-9951-0c8399bc0cc0 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:42.188233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1209/2422] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:42.202270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315296a3-bbdf-4c2a-86d1-2b9b939efaf6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:42.271713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315296a3-bbdf-4c2a-86d1-2b9b939efaf6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:42.276590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:42.277470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:42.277753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:42.278030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] PATH_INFO: `/v3/users/55ba9875542b403ab5780d3759e16cb9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:42.279385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ba9875542b403ab5780d3759e16cb9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:42.281401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:42.558089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ba9875542b403ab5780d3759e16cb9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:42.558735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ba9875542b403ab5780d3759e16cb9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:42.559389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ba9875542b403ab5780d3759e16cb9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:42.571941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ba9875542b403ab5780d3759e16cb9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:42.578750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ba9875542b403ab5780d3759e16cb9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:42.789877 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1214/2423] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:17:42 2022] DELETE /identity/v3/users/55ba9875542b403ab5780d3759e16cb9 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:42.794408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415b929-cb41-41c9-a709-fb06376f93f0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:42.794881 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415b929-cb41-41c9-a709-fb06376f93f0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:42.794995 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415b929-cb41-41c9-a709-fb06376f93f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:42.812822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d415b929-cb41-41c9-a709-fb06376f93f0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:42.814313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d415b929-cb41-41c9-a709-fb06376f93f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:42.880104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1210/2424] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:42.889767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:42.891183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:42.935654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:42.950762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584edfbe-d60a-4eac-94c3-e60c40f68b12 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:42.954892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06edc4-14d5-449c-a8b1-08278ab94363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:42.955526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06edc4-14d5-449c-a8b1-08278ab94363 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:42.955867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06edc4-14d5-449c-a8b1-08278ab94363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:42.956074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06edc4-14d5-449c-a8b1-08278ab94363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:42.964985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06edc4-14d5-449c-a8b1-08278ab94363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:42.966400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06edc4-14d5-449c-a8b1-08278ab94363 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:42.976596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1215/2425] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:17:43.463250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415b929-cb41-41c9-a709-fb06376f93f0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:43.465016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d415b929-cb41-41c9-a709-fb06376f93f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:43.479550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415b929-cb41-41c9-a709-fb06376f93f0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:43.487214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:43.488215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:43.488531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:43.488812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] PATH_INFO: `/v3/projects/be88cb651336446283fe64175cf0d9cc` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:43.490034 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be88cb651336446283fe64175cf0d9cc)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:43.492088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:43.503705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:43.628011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be88cb651336446283fe64175cf0d9cc', 'request_id': 'req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:43.746930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be88cb651336446283fe64175cf0d9cc', 'request_id': 'req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:43.754593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be88cb651336446283fe64175cf0d9cc', 'request_id': 'req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:43.765573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] The token cache is being invalidate because project be88cb651336446283fe64175cf0d9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:17:43.765859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:43.767165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e9dbc1be-bba0-4e16-bec5-ac373f5a91f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:43.768885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1211/2426] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:17:43 2022] DELETE /identity/v3/projects/be88cb651336446283fe64175cf0d9cc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:43.773984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85519f4-bf09-410d-a9d5-df316be804ac None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:43.774528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85519f4-bf09-410d-a9d5-df316be804ac None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:43.774528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85519f4-bf09-410d-a9d5-df316be804ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:43.793549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e85519f4-bf09-410d-a9d5-df316be804ac None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:43.794779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e85519f4-bf09-410d-a9d5-df316be804ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:43.859170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1216/2427] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:43.867330 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf7a72-3030-445f-a142-5330a0040e31 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:43.867821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf7a72-3030-445f-a142-5330a0040e31 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:43.867964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf7a72-3030-445f-a142-5330a0040e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:43.887188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fabf7a72-3030-445f-a142-5330a0040e31 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:43.888436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fabf7a72-3030-445f-a142-5330a0040e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:43.897325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1212/2428] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:43.901765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85519f4-bf09-410d-a9d5-df316be804ac None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:43.911941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85519f4-bf09-410d-a9d5-df316be804ac None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:43.916773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:43.917429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:43.917710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:43.917984 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:43.918699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:17:43.919007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:43.920716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:43.933142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1217/2429] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:17:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:17:43.942117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf7a72-3030-445f-a142-5330a0040e31 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:43.951567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf7a72-3030-445f-a142-5330a0040e31 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:43.957107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbdf2c-e6c9-433b-83ca-cecd243875dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:43.957760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdf2c-e6c9-433b-83ca-cecd243875dc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:43.958038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdf2c-e6c9-433b-83ca-cecd243875dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:43.958310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdf2c-e6c9-433b-83ca-cecd243875dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:43.959007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbdf2c-e6c9-433b-83ca-cecd243875dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:43.960964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbdf2c-e6c9-433b-83ca-cecd243875dc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:44.069455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1213/2430] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:17:43 2022] POST /identity/v3/projects => generated 366 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:44.073858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:44.084808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62366e32-1e95-4285-90d2-dc98c7e77296 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:44.154779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3828e8-5115-438c-bb8d-19a66bbc5ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:44.155455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3828e8-5115-438c-bb8d-19a66bbc5ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:44.155747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3828e8-5115-438c-bb8d-19a66bbc5ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:44.156037 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3828e8-5115-438c-bb8d-19a66bbc5ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:44.156731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3828e8-5115-438c-bb8d-19a66bbc5ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:44.158845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3828e8-5115-438c-bb8d-19a66bbc5ebf admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:44.283418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1218/2431] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:17:44 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:44.287691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbdf2c-e6c9-433b-83ca-cecd243875dc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:44.299527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbdf2c-e6c9-433b-83ca-cecd243875dc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:44.304245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6567533-ffbb-4f84-a4e7-4ce5a061b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:44.304938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6567533-ffbb-4f84-a4e7-4ce5a061b1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:44.305218 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6567533-ffbb-4f84-a4e7-4ce5a061b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:44.305493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6567533-ffbb-4f84-a4e7-4ce5a061b1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:44.306216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6567533-ffbb-4f84-a4e7-4ce5a061b1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:44.307832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6567533-ffbb-4f84-a4e7-4ce5a061b1ec admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:44.321979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1214/2432] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:44 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:44.324855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3828e8-5115-438c-bb8d-19a66bbc5ebf admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:44.336133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3828e8-5115-438c-bb8d-19a66bbc5ebf admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:44.340910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3856c-60df-469d-9c27-269e8c1d9c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:44.341567 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3856c-60df-469d-9c27-269e8c1d9c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:44.341852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3856c-60df-469d-9c27-269e8c1d9c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:44.342128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3856c-60df-469d-9c27-269e8c1d9c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:44.342859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3856c-60df-469d-9c27-269e8c1d9c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:44.344575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3856c-60df-469d-9c27-269e8c1d9c66 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:44.354834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1219/2433] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:17:44 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:44.359028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6567533-ffbb-4f84-a4e7-4ce5a061b1ec admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:44.371353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6567533-ffbb-4f84-a4e7-4ce5a061b1ec admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:44.377214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:44.378343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:44.378624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:44.390591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] PATH_INFO: `/v3/projects/bf791211fb4e482e93bbcb9a120503ef/users/50beaafee828437e89f606600118f5ac/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:44.397091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf791211fb4e482e93bbcb9a120503ef, user_id=50beaafee828437e89f606600118f5ac, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:44.399825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:44.411244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0ecf-ce18-47e1-8272-5c417bcf55d8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:44.411525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0ecf-ce18-47e1-8272-5c417bcf55d8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:44.411829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0ecf-ce18-47e1-8272-5c417bcf55d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:44.433084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ef6b0ecf-ce18-47e1-8272-5c417bcf55d8 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:44.434347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ef6b0ecf-ce18-47e1-8272-5c417bcf55d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:44.488714 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:44.506623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1220/2434] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:17:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:44.559700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1215/2435] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:17:44 2022] PUT /identity/v3/projects/bf791211fb4e482e93bbcb9a120503ef/users/50beaafee828437e89f606600118f5ac/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:44.571074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530c20-e267-4b19-860d-f2cae6a3e5e8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:44.571364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530c20-e267-4b19-860d-f2cae6a3e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:44.571641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530c20-e267-4b19-860d-f2cae6a3e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:44.601505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ee530c20-e267-4b19-860d-f2cae6a3e5e8 None None] MFA Rules not processed for user `50beaafee828437e89f606600118f5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:44.602743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ee530c20-e267-4b19-860d-f2cae6a3e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:44.671097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:44.673298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:44.680087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1221/2436] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:17:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:44.693609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee530c20-e267-4b19-860d-f2cae6a3e5e8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:44.695105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ee530c20-e267-4b19-860d-f2cae6a3e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:44.758760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707fd5a-98ae-47b2-be4a-579f34b978a7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:44.758902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee530c20-e267-4b19-860d-f2cae6a3e5e8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:44.763125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:44.763953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:44.764124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8e95e-7e65-4ffd-a7f7-fbd92781c019 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:44.764496 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:44.764791 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e95e-7e65-4ffd-a7f7-fbd92781c019 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:44.764909 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:44.765072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e95e-7e65-4ffd-a7f7-fbd92781c019 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:44.765344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e95e-7e65-4ffd-a7f7-fbd92781c019 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:44.774434 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:44.775918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:44.785252 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1222/2437] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:17:44.802215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:44.827053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8e95e-7e65-4ffd-a7f7-fbd92781c019 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:44.829728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8e95e-7e65-4ffd-a7f7-fbd92781c019 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:44.838579 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1216/2438] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:17:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 18:17:54.780707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=62 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:54.943383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=11 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:56.112847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:56.114415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:56.172654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7fe4f-fab2-4971-9607-ec4c94ddf9b1 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:56.176321 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739ba0e-26c5-49a9-b27d-22df7a92925a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:56.177005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ba0e-26c5-49a9-b27d-22df7a92925a service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:56.177286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ba0e-26c5-49a9-b27d-22df7a92925a service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:56.177563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ba0e-26c5-49a9-b27d-22df7a92925a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:56.179430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4739ba0e-26c5-49a9-b27d-22df7a92925a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:56.190024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739ba0e-26c5-49a9-b27d-22df7a92925a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:56.191544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739ba0e-26c5-49a9-b27d-22df7a92925a service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:56.199848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1223/2439] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:17:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:03.218734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d1cf-5317-4fdc-bf33-ba18edf0a270 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.219304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d1cf-5317-4fdc-bf33-ba18edf0a270 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.219304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d1cf-5317-4fdc-bf33-ba18edf0a270 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.221753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1217/2440] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:18:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:18:03.228285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9e797-71a0-41de-870c-2321eaca4a0b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.230293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9e797-71a0-41de-870c-2321eaca4a0b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.230293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9e797-71a0-41de-870c-2321eaca4a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.248023 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c2f9e797-71a0-41de-870c-2321eaca4a0b None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:03.249340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c2f9e797-71a0-41de-870c-2321eaca4a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:03.330484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1224/2441] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:18:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:03.343071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100d1cf-5317-4fdc-bf33-ba18edf0a270 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:03.356089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a100d1cf-5317-4fdc-bf33-ba18edf0a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:03.411874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100d1cf-5317-4fdc-bf33-ba18edf0a270 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:03.415502 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285209d2-fdc5-4907-a267-33dd6ea16fcd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a2c87f8db748ba9264b141f059aab9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:03.416146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285209d2-fdc5-4907-a267-33dd6ea16fcd service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.416461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285209d2-fdc5-4907-a267-33dd6ea16fcd service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.416740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285209d2-fdc5-4907-a267-33dd6ea16fcd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.427771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285209d2-fdc5-4907-a267-33dd6ea16fcd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:03.429355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285209d2-fdc5-4907-a267-33dd6ea16fcd service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:03.442563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1218/2442] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:03.670382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9784b-3090-429e-bf7c-b8e84b87710d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.670628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9784b-3090-429e-bf7c-b8e84b87710d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.670838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9784b-3090-429e-bf7c-b8e84b87710d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.672210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1225/2443] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:18:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:18:03.678031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bae54-9284-4b42-afd8-6677af2ad30d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.678340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bae54-9284-4b42-afd8-6677af2ad30d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.678646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bae54-9284-4b42-afd8-6677af2ad30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.699172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-571bae54-9284-4b42-afd8-6677af2ad30d None None] MFA Rules not processed for user `66452133fd6348109e3065303947ecce`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:03.700534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-571bae54-9284-4b42-afd8-6677af2ad30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:03.710162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1219/2444] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:18:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:03.723600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9784b-3090-429e-bf7c-b8e84b87710d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:03.736549 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9784b-3090-429e-bf7c-b8e84b87710d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:03.740490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15811f-ad5c-476e-82cc-75ecfbc8b910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:03.741159 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15811f-ad5c-476e-82cc-75ecfbc8b910 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.741438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15811f-ad5c-476e-82cc-75ecfbc8b910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.741711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15811f-ad5c-476e-82cc-75ecfbc8b910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.749234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15811f-ad5c-476e-82cc-75ecfbc8b910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:03.750689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15811f-ad5c-476e-82cc-75ecfbc8b910 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:03.759290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1226/2445] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:03.849623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66cc31-1991-430d-898a-2e6e03276026 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.849908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66cc31-1991-430d-898a-2e6e03276026 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.850187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66cc31-1991-430d-898a-2e6e03276026 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.851609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1220/2446] 10.222.0.123 () {54 vars in 926 bytes} [Thu May 26 18:18:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 18:18:03.856948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190098c-2e0b-4bbc-a82f-6cc3a4b35688 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.857240 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190098c-2e0b-4bbc-a82f-6cc3a4b35688 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.857515 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190098c-2e0b-4bbc-a82f-6cc3a4b35688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.877858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9190098c-2e0b-4bbc-a82f-6cc3a4b35688 None None] MFA Rules not processed for user `6fd75bf129c642a89153efcb584406d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:03.879000 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9190098c-2e0b-4bbc-a82f-6cc3a4b35688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:03.888814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1227/2447] 10.222.0.123 () {58 vars in 1023 bytes} [Thu May 26 18:18:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:03.900632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66cc31-1991-430d-898a-2e6e03276026 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:03.902362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-da66cc31-1991-430d-898a-2e6e03276026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:03.915611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66cc31-1991-430d-898a-2e6e03276026 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:03.919341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033e3d0-a80b-4c76-a8e4-7bae9257f2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:03.919972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033e3d0-a80b-4c76-a8e4-7bae9257f2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:03.920346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033e3d0-a80b-4c76-a8e4-7bae9257f2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:03.920691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033e3d0-a80b-4c76-a8e4-7bae9257f2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:03.933568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033e3d0-a80b-4c76-a8e4-7bae9257f2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:03.935019 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033e3d0-a80b-4c76-a8e4-7bae9257f2b0 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:03.946807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1221/2448] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:04.013154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190098c-2e0b-4bbc-a82f-6cc3a4b35688 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:04.015014 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9190098c-2e0b-4bbc-a82f-6cc3a4b35688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:04.087715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190098c-2e0b-4bbc-a82f-6cc3a4b35688 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:04.092783 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:04.093429 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:04.093707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:04.093978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:04.096601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:04.108781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:04.110403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:04.121709 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1228/2449] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:18:06.760951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15c5a-8c41-4ba2-a8a4-ae6799772ca6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:06.761537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15c5a-8c41-4ba2-a8a4-ae6799772ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:06.761537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15c5a-8c41-4ba2-a8a4-ae6799772ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:06.780387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ebd15c5a-8c41-4ba2-a8a4-ae6799772ca6 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:06.781602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ebd15c5a-8c41-4ba2-a8a4-ae6799772ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:06.790001 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1222/2450] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:18:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:06.802732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:06.810356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:06.815577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9ffef-3c25-4710-91fe-6282ff0a1232 service placement] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:06.821431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4341d-792d-49e4-8ffb-02e44ca834f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:06.822215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4341d-792d-49e4-8ffb-02e44ca834f0 service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:06.825101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4341d-792d-49e4-8ffb-02e44ca834f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:06.825101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4341d-792d-49e4-8ffb-02e44ca834f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:06.833816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4341d-792d-49e4-8ffb-02e44ca834f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:06.835411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4341d-792d-49e4-8ffb-02e44ca834f0 service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:06.843765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1229/2451] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:18:16.775009 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=38 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:16.852440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:22.793576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15c5a-8c41-4ba2-a8a4-ae6799772ca6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:22.795066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ebd15c5a-8c41-4ba2-a8a4-ae6799772ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:22.812248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15c5a-8c41-4ba2-a8a4-ae6799772ca6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:22.818050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315978-930a-48a1-bd4f-636da558973a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:22.818688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315978-930a-48a1-bd4f-636da558973a service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:22.818966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315978-930a-48a1-bd4f-636da558973a service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:22.819237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315978-930a-48a1-bd4f-636da558973a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:22.821040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-94315978-930a-48a1-bd4f-636da558973a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:22.834278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315978-930a-48a1-bd4f-636da558973a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:22.835865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315978-930a-48a1-bd4f-636da558973a service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:22.847590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1223/2452] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:22.974848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4341d-792d-49e4-8ffb-02e44ca834f0 service swift] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:22.987873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4341d-792d-49e4-8ffb-02e44ca834f0 service swift] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:22.993793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f6384-1eca-4a66-ae06-fc3915665bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:22.994436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f6384-1eca-4a66-ae06-fc3915665bc9 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:22.994722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f6384-1eca-4a66-ae06-fc3915665bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:22.994996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f6384-1eca-4a66-ae06-fc3915665bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:22.996858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c52f6384-1eca-4a66-ae06-fc3915665bc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:23.057113 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f6384-1eca-4a66-ae06-fc3915665bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:23.058652 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f6384-1eca-4a66-ae06-fc3915665bc9 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:23.068638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1230/2453] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:24.797788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315978-930a-48a1-bd4f-636da558973a service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:24.863956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315978-930a-48a1-bd4f-636da558973a service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:24.868609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:24.869611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:24.869897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:24.870169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] PATH_INFO: `/v3/users/50beaafee828437e89f606600118f5ac` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:24.871358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50beaafee828437e89f606600118f5ac)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:24.873356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:24.967555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213066-bacd-49ed-a833-be4f0cab212a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:24.968634 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213066-bacd-49ed-a833-be4f0cab212a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:24.969101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213066-bacd-49ed-a833-be4f0cab212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:24.988616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-76213066-bacd-49ed-a833-be4f0cab212a None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:24.989833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-76213066-bacd-49ed-a833-be4f0cab212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:24.997036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1231/2454] 10.222.0.123 () {58 vars in 972 bytes} [Thu May 26 18:18:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:25.011421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76213066-bacd-49ed-a833-be4f0cab212a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:25.024416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76213066-bacd-49ed-a833-be4f0cab212a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:25.034030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d84ba-33ce-48bb-a8c4-9ed2dd0a7d92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:25.034933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d84ba-33ce-48bb-a8c4-9ed2dd0a7d92 service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:25.034933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d84ba-33ce-48bb-a8c4-9ed2dd0a7d92 service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:25.035326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d84ba-33ce-48bb-a8c4-9ed2dd0a7d92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:25.045326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d84ba-33ce-48bb-a8c4-9ed2dd0a7d92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:25.047003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d84ba-33ce-48bb-a8c4-9ed2dd0a7d92 service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:25.050856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50beaafee828437e89f606600118f5ac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:25.051549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50beaafee828437e89f606600118f5ac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:25.052169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50beaafee828437e89f606600118f5ac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:25.061531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1232/2455] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:18:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 18:18:25.075105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50beaafee828437e89f606600118f5ac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:25.084587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50beaafee828437e89f606600118f5ac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:25.189036 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1224/2456] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:18:24 2022] DELETE /identity/v3/users/50beaafee828437e89f606600118f5ac => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:25.194698 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348c198-d46f-40b6-a1b2-b4fbe18f9ed5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:25.195019 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348c198-d46f-40b6-a1b2-b4fbe18f9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:25.195300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348c198-d46f-40b6-a1b2-b4fbe18f9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:25.213711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f348c198-d46f-40b6-a1b2-b4fbe18f9ed5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:25.214930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f348c198-d46f-40b6-a1b2-b4fbe18f9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:25.279032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1233/2457] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:25.290046 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:25.291427 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:25.353436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91766ee7-4047-43ab-8301-6ccca9e77958 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:25.357430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b800d16-45cc-4d84-8d6f-4e4c7cdaaf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:25.358092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800d16-45cc-4d84-8d6f-4e4c7cdaaf4d service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:25.358378 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800d16-45cc-4d84-8d6f-4e4c7cdaaf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:25.358727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800d16-45cc-4d84-8d6f-4e4c7cdaaf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:25.369903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b800d16-45cc-4d84-8d6f-4e4c7cdaaf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:25.371813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b800d16-45cc-4d84-8d6f-4e4c7cdaaf4d service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:25.382935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1225/2458] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:25.874105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348c198-d46f-40b6-a1b2-b4fbe18f9ed5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:25.875825 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f348c198-d46f-40b6-a1b2-b4fbe18f9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:25.889986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348c198-d46f-40b6-a1b2-b4fbe18f9ed5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:25.896340 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:25.897212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:25.897707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:25.898029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] PATH_INFO: `/v3/projects/bf791211fb4e482e93bbcb9a120503ef` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:25.899326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf791211fb4e482e93bbcb9a120503ef)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:25.901759 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:26.043789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf791211fb4e482e93bbcb9a120503ef', 'request_id': 'req-f5490087-4b65-4496-b194-72a4788fbc11'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:26.196231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf791211fb4e482e93bbcb9a120503ef', 'request_id': 'req-f5490087-4b65-4496-b194-72a4788fbc11'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:26.205666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf791211fb4e482e93bbcb9a120503ef', 'request_id': 'req-f5490087-4b65-4496-b194-72a4788fbc11'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:26.226952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] The token cache is being invalidate because project bf791211fb4e482e93bbcb9a120503ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:18:26.227433 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:26.228199 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f5490087-4b65-4496-b194-72a4788fbc11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:26.230432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1234/2459] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:18:25 2022] DELETE /identity/v3/projects/bf791211fb4e482e93bbcb9a120503ef => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:26.235721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf7cc-e43d-486f-a800-51a4e4de9670 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:26.236748 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf7cc-e43d-486f-a800-51a4e4de9670 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:26.236912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf7cc-e43d-486f-a800-51a4e4de9670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:26.255131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-46bcf7cc-e43d-486f-a800-51a4e4de9670 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:26.256355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-46bcf7cc-e43d-486f-a800-51a4e4de9670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:26.280134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:26.328246 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1226/2460] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:26.337637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1092-931f-40b3-a903-4850ff9d8a09 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:26.337924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1092-931f-40b3-a903-4850ff9d8a09 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:26.338204 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb1092-931f-40b3-a903-4850ff9d8a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:26.344881 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:26.360173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-23cb1092-931f-40b3-a903-4850ff9d8a09 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:26.362314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-23cb1092-931f-40b3-a903-4850ff9d8a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:26.370810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1235/2461] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:26.380348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcf7cc-e43d-486f-a800-51a4e4de9670 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:26.390209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcf7cc-e43d-486f-a800-51a4e4de9670 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:26.395394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:26.396086 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:26.396421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:26.396708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:26.397434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:18:26.397750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:26.399401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:26.413332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1227/2462] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:18:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:18:26.417609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb1092-931f-40b3-a903-4850ff9d8a09 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:26.427989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb1092-931f-40b3-a903-4850ff9d8a09 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:26.433075 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68ede1-d83f-457f-93ff-ced6a3ef1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:26.433750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68ede1-d83f-457f-93ff-ced6a3ef1346 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:26.434032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68ede1-d83f-457f-93ff-ced6a3ef1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:26.434315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68ede1-d83f-457f-93ff-ced6a3ef1346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:26.435029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68ede1-d83f-457f-93ff-ced6a3ef1346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:26.437015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68ede1-d83f-457f-93ff-ced6a3ef1346 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:26.624336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1236/2463] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:18:26 2022] POST /identity/v3/projects => generated 390 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:26.626604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:26.638904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a617cc-6905-4ecb-a43e-7eaac860cb8c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:26.706376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49633f-5820-435b-8466-b54b454c9d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:26.707051 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49633f-5820-435b-8466-b54b454c9d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:26.707334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49633f-5820-435b-8466-b54b454c9d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:26.707611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49633f-5820-435b-8466-b54b454c9d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:26.708347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49633f-5820-435b-8466-b54b454c9d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:26.710537 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49633f-5820-435b-8466-b54b454c9d16 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:26.875504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1228/2464] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:18:26 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:26.879842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68ede1-d83f-457f-93ff-ced6a3ef1346 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:26.891722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68ede1-d83f-457f-93ff-ced6a3ef1346 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:26.899406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c654979-e535-48da-bdc3-f636418b6d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:26.904670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654979-e535-48da-bdc3-f636418b6d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:26.904670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654979-e535-48da-bdc3-f636418b6d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:26.904670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654979-e535-48da-bdc3-f636418b6d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:26.904670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c654979-e535-48da-bdc3-f636418b6d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:26.904670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c654979-e535-48da-bdc3-f636418b6d4b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:26.915132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1237/2465] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:26 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:26.919134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49633f-5820-435b-8466-b54b454c9d16 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:26.931908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49633f-5820-435b-8466-b54b454c9d16 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:26.936626 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b000-b5b5-4e97-b60a-f1cb8d5969c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:26.937281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b000-b5b5-4e97-b60a-f1cb8d5969c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:26.938858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b000-b5b5-4e97-b60a-f1cb8d5969c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:26.938858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b000-b5b5-4e97-b60a-f1cb8d5969c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:26.938858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b000-b5b5-4e97-b60a-f1cb8d5969c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:26.940327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b000-b5b5-4e97-b60a-f1cb8d5969c6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:26.952352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1229/2466] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:26 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:26.956466 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c654979-e535-48da-bdc3-f636418b6d4b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:26.967689 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c654979-e535-48da-bdc3-f636418b6d4b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:26.973107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:26.974016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:26.974299 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:26.974577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] PATH_INFO: `/v3/projects/0b5d6121193d4d2f83c6c1b1317f4626/users/f3aa542fdf214430813fda4e0a21d9d9/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:26.990460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5d6121193d4d2f83c6c1b1317f4626, user_id=f3aa542fdf214430813fda4e0a21d9d9, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:26.993180 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:27.116971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1238/2467] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:26 2022] PUT /identity/v3/projects/0b5d6121193d4d2f83c6c1b1317f4626/users/f3aa542fdf214430813fda4e0a21d9d9/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:18:27.128601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a7b0-da18-4b57-a285-d9e34b90acca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:27.128889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a7b0-da18-4b57-a285-d9e34b90acca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:27.129166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a7b0-da18-4b57-a285-d9e34b90acca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:27.159876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e380a7b0-da18-4b57-a285-d9e34b90acca None None] MFA Rules not processed for user `f3aa542fdf214430813fda4e0a21d9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:27.161144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e380a7b0-da18-4b57-a285-d9e34b90acca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:27.235382 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1230/2468] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:27.380884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:27.383183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:27.444367 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172209e-ed19-47c4-abc9-95547e21a075 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:27.448106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bf8d7-fe63-4798-9357-d5ac1672a8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:27.448794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bf8d7-fe63-4798-9357-d5ac1672a8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:27.449078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bf8d7-fe63-4798-9357-d5ac1672a8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:27.449355 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bf8d7-fe63-4798-9357-d5ac1672a8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:27.459888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bf8d7-fe63-4798-9357-d5ac1672a8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:27.461566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bf8d7-fe63-4798-9357-d5ac1672a8b2 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:27.471780 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1239/2469] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:35.715362 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a7b0-da18-4b57-a285-d9e34b90acca None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:35.726973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e380a7b0-da18-4b57-a285-d9e34b90acca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:35.726973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:35.816583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a7b0-da18-4b57-a285-d9e34b90acca None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:35.823519 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:35.824359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:35.824739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:35.825114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:35.827301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:35.853855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:35.856672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:35.886491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1231/2470] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:37.467570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:38.460992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bf8d7-fe63-4798-9357-d5ac1672a8b2 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:38.479261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bf8d7-fe63-4798-9357-d5ac1672a8b2 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:38.485699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc04cf-fff1-41ec-b0b8-711c1cb70e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:38.486928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc04cf-fff1-41ec-b0b8-711c1cb70e16 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:38.487101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc04cf-fff1-41ec-b0b8-711c1cb70e16 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:38.487752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc04cf-fff1-41ec-b0b8-711c1cb70e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:38.492900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8acc04cf-fff1-41ec-b0b8-711c1cb70e16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:38.571457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc04cf-fff1-41ec-b0b8-711c1cb70e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:38.573029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc04cf-fff1-41ec-b0b8-711c1cb70e16 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:38.585946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1240/2471] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:39.988408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:40.052594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96843a0e-7bdc-4791-8bd0-49531278ca7f service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:40.057026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:40.057891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:40.058174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:40.058452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] PATH_INFO: `/v3/users/f3aa542fdf214430813fda4e0a21d9d9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:40.059650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3aa542fdf214430813fda4e0a21d9d9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:40.061629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:40.319888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3aa542fdf214430813fda4e0a21d9d9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:40.320511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3aa542fdf214430813fda4e0a21d9d9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:40.321114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3aa542fdf214430813fda4e0a21d9d9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:40.335732 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3aa542fdf214430813fda4e0a21d9d9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:40.343428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3aa542fdf214430813fda4e0a21d9d9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:40.443957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1232/2472] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:18:39 2022] DELETE /identity/v3/users/f3aa542fdf214430813fda4e0a21d9d9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:40.448790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7df1-4e15-40b9-9a63-5ed4484a8d4d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:40.449531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7df1-4e15-40b9-9a63-5ed4484a8d4d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:40.449846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7df1-4e15-40b9-9a63-5ed4484a8d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:40.468576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9e5f7df1-4e15-40b9-9a63-5ed4484a8d4d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:40.469779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9e5f7df1-4e15-40b9-9a63-5ed4484a8d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:40.532057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1241/2473] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:40.542395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:40.543836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:40.558193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:40.607624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44426e8-1880-4ce4-8dab-f764460978c8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:40.612126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ff89d-3fcf-4d3e-8f5d-f5b8b424d4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:40.612897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ff89d-3fcf-4d3e-8f5d-f5b8b424d4ea service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:40.613166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ff89d-3fcf-4d3e-8f5d-f5b8b424d4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:40.640261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ff89d-3fcf-4d3e-8f5d-f5b8b424d4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:40.640261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ff89d-3fcf-4d3e-8f5d-f5b8b424d4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:40.640261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ff89d-3fcf-4d3e-8f5d-f5b8b424d4ea service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:40.640261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1233/2474] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:41.604980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7df1-4e15-40b9-9a63-5ed4484a8d4d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:41.606415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9e5f7df1-4e15-40b9-9a63-5ed4484a8d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:41.621690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7df1-4e15-40b9-9a63-5ed4484a8d4d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:41.626572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:41.627952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:41.628436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:41.628742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] PATH_INFO: `/v3/projects/0b5d6121193d4d2f83c6c1b1317f4626` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:41.630135 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5d6121193d4d2f83c6c1b1317f4626)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:41.632111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:41.799642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5d6121193d4d2f83c6c1b1317f4626', 'request_id': 'req-9d8c9f86-7641-490f-be8b-1601d15a3e3a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:41.884529 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5d6121193d4d2f83c6c1b1317f4626', 'request_id': 'req-9d8c9f86-7641-490f-be8b-1601d15a3e3a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:41.891721 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5d6121193d4d2f83c6c1b1317f4626', 'request_id': 'req-9d8c9f86-7641-490f-be8b-1601d15a3e3a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:41.921930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] The token cache is being invalidate because project 0b5d6121193d4d2f83c6c1b1317f4626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:18:41.921930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:41.921930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9d8c9f86-7641-490f-be8b-1601d15a3e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:41.923292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1242/2475] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:18:41 2022] DELETE /identity/v3/projects/0b5d6121193d4d2f83c6c1b1317f4626 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:41.930173 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc96b9-5c26-4a7d-a510-e9752c3d7434 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:41.930687 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc96b9-5c26-4a7d-a510-e9752c3d7434 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:41.931213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc96b9-5c26-4a7d-a510-e9752c3d7434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:41.958890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5abc96b9-5c26-4a7d-a510-e9752c3d7434 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:41.960892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5abc96b9-5c26-4a7d-a510-e9752c3d7434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:42.049517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1234/2476] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:42.058083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af25c-df6d-4a62-84cc-be17ce5bcd79 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.058274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af25c-df6d-4a62-84cc-be17ce5bcd79 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.058562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af25c-df6d-4a62-84cc-be17ce5bcd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.083062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a50af25c-df6d-4a62-84cc-be17ce5bcd79 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:42.084406 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a50af25c-df6d-4a62-84cc-be17ce5bcd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:42.094476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1243/2477] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:18:42.099201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc96b9-5c26-4a7d-a510-e9752c3d7434 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:42.109805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc96b9-5c26-4a7d-a510-e9752c3d7434 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:42.115860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:42.116729 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.117115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.117556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.118754 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:18:42.119622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:42.122299 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:42.145288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1235/2478] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:18:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:18:42.145448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af25c-df6d-4a62-84cc-be17ce5bcd79 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:42.157251 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af25c-df6d-4a62-84cc-be17ce5bcd79 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:42.167856 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c4b92-8ee4-4943-8bb9-937304ae572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:42.168722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4b92-8ee4-4943-8bb9-937304ae572d admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.170810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4b92-8ee4-4943-8bb9-937304ae572d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.170810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4b92-8ee4-4943-8bb9-937304ae572d admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.170810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c4b92-8ee4-4943-8bb9-937304ae572d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:42.172347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c4b92-8ee4-4943-8bb9-937304ae572d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:42.196292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:42.314262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1244/2479] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:18:42 2022] POST /identity/v3/projects => generated 386 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:42.316740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:42.329234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87cc9f-da29-4767-a5fc-cddc1690d1fb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:42.436194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a87bd9-864e-43b4-9ac7-dda7cd8ee82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:42.440903 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87bd9-864e-43b4-9ac7-dda7cd8ee82f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.442199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87bd9-864e-43b4-9ac7-dda7cd8ee82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.442916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87bd9-864e-43b4-9ac7-dda7cd8ee82f admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.445863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a87bd9-864e-43b4-9ac7-dda7cd8ee82f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:42.450587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a87bd9-864e-43b4-9ac7-dda7cd8ee82f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:42.569727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1236/2480] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:18:42 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:18:42.571109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c4b92-8ee4-4943-8bb9-937304ae572d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:42.597970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c4b92-8ee4-4943-8bb9-937304ae572d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:42.604923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ed25-d941-4d3c-911a-5c910610b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:42.605540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ed25-d941-4d3c-911a-5c910610b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.607041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ed25-d941-4d3c-911a-5c910610b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.607041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ed25-d941-4d3c-911a-5c910610b7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.607411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811ed25-d941-4d3c-911a-5c910610b7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:42.608934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811ed25-d941-4d3c-911a-5c910610b7d0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:42.625834 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1245/2481] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:42 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:42.627596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a87bd9-864e-43b4-9ac7-dda7cd8ee82f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:42.642871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a87bd9-864e-43b4-9ac7-dda7cd8ee82f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:42.647987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:42.648837 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.653955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.653955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.653955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:42.653955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:42.664572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1237/2482] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:42 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:42.668916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ed25-d941-4d3c-911a-5c910610b7d0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:42.687550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:42.690388 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:42.699119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ed25-d941-4d3c-911a-5c910610b7d0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:42.705888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:42.707955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.708459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.708883 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] PATH_INFO: `/v3/projects/9066457724434c9593660f92733003b5/users/7f86adaf1fff4b94b2911633b61adefe/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.719597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:42.726918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9066457724434c9593660f92733003b5, user_id=7f86adaf1fff4b94b2911633b61adefe, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:42.730052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:42.771891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019edc7-e11c-4935-ba88-c04303f8510e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:42.776189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e6738-1dfe-4936-8a7e-0c43160cee7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:42.777033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6738-1dfe-4936-8a7e-0c43160cee7c service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.777441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6738-1dfe-4936-8a7e-0c43160cee7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.777777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e6738-1dfe-4936-8a7e-0c43160cee7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.780003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-643e6738-1dfe-4936-8a7e-0c43160cee7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:42.797263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e6738-1dfe-4936-8a7e-0c43160cee7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:42.803098 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e6738-1dfe-4936-8a7e-0c43160cee7c service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:42.812757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1238/2483] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:18:42.839929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1246/2484] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:42 2022] PUT /identity/v3/projects/9066457724434c9593660f92733003b5/users/7f86adaf1fff4b94b2911633b61adefe/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:42.845054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ace41e-36d3-4e82-baf0-38b398d3437b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:42.845345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ace41e-36d3-4e82-baf0-38b398d3437b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:42.845622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ace41e-36d3-4e82-baf0-38b398d3437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:42.873485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-89ace41e-36d3-4e82-baf0-38b398d3437b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:42.877306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89ace41e-36d3-4e82-baf0-38b398d3437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:42.963430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1239/2485] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:18:42.975572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:42.977476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:43.083462 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54103fc8-5fc1-40ce-b733-c96f825cb207 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:43.089941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:43.090650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:43.090936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:43.094560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:43.105749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:43.107283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:43.130009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1247/2486] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:18:47.740035 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ace41e-36d3-4e82-baf0-38b398d3437b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:47.742883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89ace41e-36d3-4e82-baf0-38b398d3437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:47.827915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ace41e-36d3-4e82-baf0-38b398d3437b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:47.833882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:47.834544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:47.834889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:47.835293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:47.837149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:47.852285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:47.853930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:47.865731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1240/2487] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:48.043845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:48.051072 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:48.062412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739e05f-f558-4a54-bca2-a6c69beb9df9 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:48.069197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:48.070647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:48.071040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:48.071307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] PATH_INFO: `/v3/users/09ad128756994ea0b6333d0694b840b9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:48.072603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ad128756994ea0b6333d0694b840b9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:48.074659 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:48.372826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ad128756994ea0b6333d0694b840b9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:48.373593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ad128756994ea0b6333d0694b840b9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:48.374443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ad128756994ea0b6333d0694b840b9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:48.390663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ad128756994ea0b6333d0694b840b9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:48.400773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3acadd50-631a-464e-929f-62da66a9e7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ad128756994ea0b6333d0694b840b9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:48.563419 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1248/2488] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:18:48 2022] DELETE /identity/v3/users/09ad128756994ea0b6333d0694b840b9 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:48.919369 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:48.938654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202baba-6990-410f-9aa9-f63eda7b2678 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:48.997521 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:49.009670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:49.010543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:49.010816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:49.011280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] PATH_INFO: `/v3/projects/058135db20b74c1887487e4368245e00` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:49.012861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] RBAC: Authorizing `identity:delete_project(project_id=058135db20b74c1887487e4368245e00)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:49.014707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:49.226456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058135db20b74c1887487e4368245e00', 'request_id': 'req-6bb4e736-f543-4aea-be56-3b417242478c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:49.372548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058135db20b74c1887487e4368245e00', 'request_id': 'req-6bb4e736-f543-4aea-be56-3b417242478c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:49.381764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058135db20b74c1887487e4368245e00', 'request_id': 'req-6bb4e736-f543-4aea-be56-3b417242478c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:49.396591 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] The token cache is being invalidate because project 058135db20b74c1887487e4368245e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:18:49.397047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:49.398331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bb4e736-f543-4aea-be56-3b417242478c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:49.400489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1241/2489] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:18:48 2022] DELETE /identity/v3/projects/058135db20b74c1887487e4368245e00 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:49.405195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69590e-7594-449c-80bd-42e955d09a63 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:49.405706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69590e-7594-449c-80bd-42e955d09a63 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:49.405819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69590e-7594-449c-80bd-42e955d09a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:49.426112 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9f69590e-7594-449c-80bd-42e955d09a63 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:49.427600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9f69590e-7594-449c-80bd-42e955d09a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:49.467196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:49.503302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1249/2490] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:18:49.511955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79525d8f-cf30-4421-b9af-44091c86fb3c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:49.512242 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79525d8f-cf30-4421-b9af-44091c86fb3c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:49.512598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79525d8f-cf30-4421-b9af-44091c86fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:49.533333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-79525d8f-cf30-4421-b9af-44091c86fb3c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:49.534970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-79525d8f-cf30-4421-b9af-44091c86fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:49.545814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1242/2491] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:49.551215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69590e-7594-449c-80bd-42e955d09a63 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:49.562154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69590e-7594-449c-80bd-42e955d09a63 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:49.568143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:49.568945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:49.569336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:49.569691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:49.570499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:18:49.570880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:49.572722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:49.591715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1250/2492] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:18:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:18:49.591907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79525d8f-cf30-4421-b9af-44091c86fb3c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:49.601595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79525d8f-cf30-4421-b9af-44091c86fb3c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:49.607431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714f6b-0e1e-46fc-870e-f8dfcb7d1e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:49.608642 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714f6b-0e1e-46fc-870e-f8dfcb7d1e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:49.608968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714f6b-0e1e-46fc-870e-f8dfcb7d1e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:49.609337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714f6b-0e1e-46fc-870e-f8dfcb7d1e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:49.610719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714f6b-0e1e-46fc-870e-f8dfcb7d1e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:49.613627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714f6b-0e1e-46fc-870e-f8dfcb7d1e1d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:49.741756 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:49.743578 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:49.804519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61cdb3-8ba5-4b71-8880-9b77dd779adb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:49.808170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1243/2493] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:18:49 2022] POST /identity/v3/projects => generated 382 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:18:49.812885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714f6b-0e1e-46fc-870e-f8dfcb7d1e1d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:49.816191 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:49.817047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:49.817437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:49.818815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:49.821139 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:49.837108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:49.839231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:49.859399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1251/2494] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:18:49.907286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714f6b-0e1e-46fc-870e-f8dfcb7d1e1d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:49.913734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0f52-2b11-4c91-842a-f874450cedb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:49.913932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0f52-2b11-4c91-842a-f874450cedb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:49.914063 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0f52-2b11-4c91-842a-f874450cedb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:49.914349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0f52-2b11-4c91-842a-f874450cedb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:49.916338 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0f52-2b11-4c91-842a-f874450cedb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:49.917103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0f52-2b11-4c91-842a-f874450cedb4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:50.061559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1244/2495] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:18:49 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:18:50.066057 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:50.085094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ae72-aa93-4ca5-8846-d39b69fce007 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:50.095498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e8654-7ab7-4fd2-be3c-4ecda6d1cde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:50.097255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e8654-7ab7-4fd2-be3c-4ecda6d1cde1 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:50.097775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e8654-7ab7-4fd2-be3c-4ecda6d1cde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:50.098272 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e8654-7ab7-4fd2-be3c-4ecda6d1cde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:50.104500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e8654-7ab7-4fd2-be3c-4ecda6d1cde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:50.122753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e8654-7ab7-4fd2-be3c-4ecda6d1cde1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:50.141404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1252/2496] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:50 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:50.145005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0f52-2b11-4c91-842a-f874450cedb4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:50.164453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0f52-2b11-4c91-842a-f874450cedb4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:50.179164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab01a8c-da1b-44cc-9f83-4df1c328c6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:50.180103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01a8c-da1b-44cc-9f83-4df1c328c6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:50.180629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01a8c-da1b-44cc-9f83-4df1c328c6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:50.180985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01a8c-da1b-44cc-9f83-4df1c328c6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:50.181809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab01a8c-da1b-44cc-9f83-4df1c328c6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:50.185243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab01a8c-da1b-44cc-9f83-4df1c328c6cf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:50.212778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1245/2497] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:50 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:50.216791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e8654-7ab7-4fd2-be3c-4ecda6d1cde1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:50.235431 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e8654-7ab7-4fd2-be3c-4ecda6d1cde1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:50.249911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09003-7e49-465d-86e4-3abf36768d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:50.251049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09003-7e49-465d-86e4-3abf36768d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:50.254726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09003-7e49-465d-86e4-3abf36768d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:50.255133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09003-7e49-465d-86e4-3abf36768d1a admin admin] PATH_INFO: `/v3/projects/21d8e6dafacd42afb47fb95c036bb5c0/users/4a44a18c4f034d5493600265de2039c1/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:50.282348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09003-7e49-465d-86e4-3abf36768d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d8e6dafacd42afb47fb95c036bb5c0, user_id=4a44a18c4f034d5493600265de2039c1, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:50.286416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09003-7e49-465d-86e4-3abf36768d1a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:50.425183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1253/2498] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:50 2022] PUT /identity/v3/projects/21d8e6dafacd42afb47fb95c036bb5c0/users/4a44a18c4f034d5493600265de2039c1/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:18:50.438294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956846d-86dc-498a-8fdb-7e9c718c93c6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:50.438972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956846d-86dc-498a-8fdb-7e9c718c93c6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:50.439560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956846d-86dc-498a-8fdb-7e9c718c93c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:50.473720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7956846d-86dc-498a-8fdb-7e9c718c93c6 None None] MFA Rules not processed for user `4a44a18c4f034d5493600265de2039c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:50.475538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7956846d-86dc-498a-8fdb-7e9c718c93c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:50.502373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:50.583771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1246/2499] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:50.589840 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09003-7e49-465d-86e4-3abf36768d1a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:50.673992 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09003-7e49-465d-86e4-3abf36768d1a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:50.679736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf62cb-d11e-442d-a38e-394eb411394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:50.680604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf62cb-d11e-442d-a38e-394eb411394e admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:50.680947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf62cb-d11e-442d-a38e-394eb411394e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:50.690418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf62cb-d11e-442d-a38e-394eb411394e admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:50.690418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf62cb-d11e-442d-a38e-394eb411394e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:50.690418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf62cb-d11e-442d-a38e-394eb411394e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:50.827888 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1254/2500] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:18:50 2022] POST /identity/v3/projects => generated 380 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:18:50.832751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956846d-86dc-498a-8fdb-7e9c718c93c6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:50.850628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956846d-86dc-498a-8fdb-7e9c718c93c6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:50.968835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9551-33a1-4ec5-bf78-64ddc91c472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:50.969528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9551-33a1-4ec5-bf78-64ddc91c472a admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:50.969807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9551-33a1-4ec5-bf78-64ddc91c472a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:50.970081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9551-33a1-4ec5-bf78-64ddc91c472a admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:50.978673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9551-33a1-4ec5-bf78-64ddc91c472a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:50.980838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9551-33a1-4ec5-bf78-64ddc91c472a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:51.126207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1247/2501] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:18:50 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:51.127684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf62cb-d11e-442d-a38e-394eb411394e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:51.146063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf62cb-d11e-442d-a38e-394eb411394e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:51.153627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc377e37-357d-4a7f-a23b-d2787898d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:51.154292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377e37-357d-4a7f-a23b-d2787898d958 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.154650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377e37-357d-4a7f-a23b-d2787898d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.154997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377e37-357d-4a7f-a23b-d2787898d958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:51.155833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc377e37-357d-4a7f-a23b-d2787898d958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:51.157716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc377e37-357d-4a7f-a23b-d2787898d958 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:51.176109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1255/2502] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:51 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:51.180219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9551-33a1-4ec5-bf78-64ddc91c472a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:51.195942 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9551-33a1-4ec5-bf78-64ddc91c472a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:51.207603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af851c44-93f5-440f-9207-87a2d393c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:51.215915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af851c44-93f5-440f-9207-87a2d393c534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.215915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af851c44-93f5-440f-9207-87a2d393c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.215915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af851c44-93f5-440f-9207-87a2d393c534 admin admin] PATH_INFO: `/v3/projects/db7842943ddf46eb8be5de1b39c10fa7/users/9acfda824c3149c48fa151472b302e81/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:51.237973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af851c44-93f5-440f-9207-87a2d393c534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7842943ddf46eb8be5de1b39c10fa7, user_id=9acfda824c3149c48fa151472b302e81, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:51.240797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af851c44-93f5-440f-9207-87a2d393c534 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:51.337412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1248/2503] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:51 2022] PUT /identity/v3/projects/db7842943ddf46eb8be5de1b39c10fa7/users/9acfda824c3149c48fa151472b302e81/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:51.343379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584e438-8c45-4870-8087-55130c1ae402 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.344111 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584e438-8c45-4870-8087-55130c1ae402 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.344741 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584e438-8c45-4870-8087-55130c1ae402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:51.349527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af851c44-93f5-440f-9207-87a2d393c534 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:51.363012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:51.404569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4584e438-8c45-4870-8087-55130c1ae402 None None] MFA Rules not processed for user `7f86adaf1fff4b94b2911633b61adefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:51.406353 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4584e438-8c45-4870-8087-55130c1ae402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:51.492931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af851c44-93f5-440f-9207-87a2d393c534 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:51.501678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1256/2504] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:51.503703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584e438-8c45-4870-8087-55130c1ae402 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:51.506533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4584e438-8c45-4870-8087-55130c1ae402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:51.509079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6f854-f78a-405a-9190-a3e019341584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:51.509958 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6f854-f78a-405a-9190-a3e019341584 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.511289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6f854-f78a-405a-9190-a3e019341584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.511625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6f854-f78a-405a-9190-a3e019341584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:51.513511 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6f854-f78a-405a-9190-a3e019341584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:51.517341 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6f854-f78a-405a-9190-a3e019341584 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:51.530980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1249/2505] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:51 2022] GET /identity/v3/roles => generated 1427 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:51.535457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6f854-f78a-405a-9190-a3e019341584 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:51.543547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584e438-8c45-4870-8087-55130c1ae402 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:51.557666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6f854-f78a-405a-9190-a3e019341584 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:51.559758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0ed61-178c-4fcb-969b-36a78c457883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:51.560579 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ed61-178c-4fcb-969b-36a78c457883 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.560979 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ed61-178c-4fcb-969b-36a78c457883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.562165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ed61-178c-4fcb-969b-36a78c457883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:51.563162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0ed61-178c-4fcb-969b-36a78c457883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:51.568354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0ed61-178c-4fcb-969b-36a78c457883 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:51.577629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98779d0e-527a-4dee-87cb-1c39487b0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:51.578759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779d0e-527a-4dee-87cb-1c39487b0f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.579157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779d0e-527a-4dee-87cb-1c39487b0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.579917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779d0e-527a-4dee-87cb-1c39487b0f07 admin admin] PATH_INFO: `/v3/projects/db7842943ddf46eb8be5de1b39c10fa7/users/9acfda824c3149c48fa151472b302e81/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:51.585329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98779d0e-527a-4dee-87cb-1c39487b0f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7842943ddf46eb8be5de1b39c10fa7, user_id=9acfda824c3149c48fa151472b302e81, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:51.592802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98779d0e-527a-4dee-87cb-1c39487b0f07 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:51.614702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1250/2506] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:51 2022] PUT /identity/v3/projects/db7842943ddf46eb8be5de1b39c10fa7/users/9acfda824c3149c48fa151472b302e81/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:51.632375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6e34-00fb-457b-acee-7c1e54f95a56 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.632375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6e34-00fb-457b-acee-7c1e54f95a56 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.632375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6e34-00fb-457b-acee-7c1e54f95a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:51.690603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cefd6e34-00fb-457b-acee-7c1e54f95a56 None None] MFA Rules not processed for user `9acfda824c3149c48fa151472b302e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:51.692240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cefd6e34-00fb-457b-acee-7c1e54f95a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:51.765653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1257/2507] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:18:51 2022] POST /identity/v3/projects => generated 386 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:51.766781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0ed61-178c-4fcb-969b-36a78c457883 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:51.774456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1251/2508] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:51.790312 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd6e34-00fb-457b-acee-7c1e54f95a56 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:51.792752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cefd6e34-00fb-457b-acee-7c1e54f95a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:51.850617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:51.873959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd6e34-00fb-457b-acee-7c1e54f95a56 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:51.888970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0ed61-178c-4fcb-969b-36a78c457883 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:51.896838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a936-4c14-49cd-8012-3fa289937f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:51.897627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a936-4c14-49cd-8012-3fa289937f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.897911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a936-4c14-49cd-8012-3fa289937f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.898188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1a936-4c14-49cd-8012-3fa289937f17 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:51.899472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1a936-4c14-49cd-8012-3fa289937f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:51.902370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1a936-4c14-49cd-8012-3fa289937f17 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:51.934566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f140f3-3fed-4865-9a11-f28b92674412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:51.935211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f140f3-3fed-4865-9a11-f28b92674412 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:51.935588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f140f3-3fed-4865-9a11-f28b92674412 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:51.935939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f140f3-3fed-4865-9a11-f28b92674412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:52.000081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f140f3-3fed-4865-9a11-f28b92674412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:52.001671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f140f3-3fed-4865-9a11-f28b92674412 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:52.012010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1252/2509] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:18:52.031381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1258/2510] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:18:51 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:52.040291 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f140f3-3fed-4865-9a11-f28b92674412 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:52.043374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f140f3-3fed-4865-9a11-f28b92674412 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:52.048356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf85bb-c4ea-44dd-b6ed-169cfc67d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:52.049771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf85bb-c4ea-44dd-b6ed-169cfc67d844 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:52.050260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf85bb-c4ea-44dd-b6ed-169cfc67d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:52.050915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf85bb-c4ea-44dd-b6ed-169cfc67d844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:52.051657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf85bb-c4ea-44dd-b6ed-169cfc67d844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:52.053366 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf85bb-c4ea-44dd-b6ed-169cfc67d844 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:52.067348 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1253/2511] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:52 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:18:52.068926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a936-4c14-49cd-8012-3fa289937f17 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:52.085795 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1a936-4c14-49cd-8012-3fa289937f17 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:52.091131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9864c-b2ac-45d7-9682-1c6d31f54692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:52.091993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9864c-b2ac-45d7-9682-1c6d31f54692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:52.092273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9864c-b2ac-45d7-9682-1c6d31f54692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:52.092635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9864c-b2ac-45d7-9682-1c6d31f54692 admin admin] PATH_INFO: `/v3/projects/43a19b1c729c48068defa7079af9cd37/users/2c1ab8e813de4d19ba05cd752d95b8cc/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:52.110176 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9864c-b2ac-45d7-9682-1c6d31f54692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a19b1c729c48068defa7079af9cd37, user_id=2c1ab8e813de4d19ba05cd752d95b8cc, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:52.113038 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9864c-b2ac-45d7-9682-1c6d31f54692 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:52.193519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1259/2512] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:52 2022] PUT /identity/v3/projects/43a19b1c729c48068defa7079af9cd37/users/2c1ab8e813de4d19ba05cd752d95b8cc/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:52.195270 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf85bb-c4ea-44dd-b6ed-169cfc67d844 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:52.207738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf85bb-c4ea-44dd-b6ed-169cfc67d844 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:52.240286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9864c-b2ac-45d7-9682-1c6d31f54692 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:52.300240 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6d13-fb34-45b8-92c1-f44907119944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:52.302346 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6d13-fb34-45b8-92c1-f44907119944 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:52.302807 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6d13-fb34-45b8-92c1-f44907119944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:52.303885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6d13-fb34-45b8-92c1-f44907119944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:52.305304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f6d13-fb34-45b8-92c1-f44907119944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:52.307456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f6d13-fb34-45b8-92c1-f44907119944 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:52.324906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1254/2513] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:52 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:52.328858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6d13-fb34-45b8-92c1-f44907119944 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:52.332486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9864c-b2ac-45d7-9682-1c6d31f54692 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:52.336564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8c949-0cf7-4c1f-a6c3-2c1a8364b164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:52.337319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8c949-0cf7-4c1f-a6c3-2c1a8364b164 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:52.337488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8c949-0cf7-4c1f-a6c3-2c1a8364b164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:52.337769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8c949-0cf7-4c1f-a6c3-2c1a8364b164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:52.352129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6d13-fb34-45b8-92c1-f44907119944 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:52.353548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:52.354826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:52.355365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:52.356979 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] PATH_INFO: `/v3/projects/43a19b1c729c48068defa7079af9cd37/users/2c1ab8e813de4d19ba05cd752d95b8cc/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:52.360116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a19b1c729c48068defa7079af9cd37, user_id=2c1ab8e813de4d19ba05cd752d95b8cc, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:52.363564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:52.379063 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1255/2514] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:52 2022] PUT /identity/v3/projects/43a19b1c729c48068defa7079af9cd37/users/2c1ab8e813de4d19ba05cd752d95b8cc/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:52.414744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8c949-0cf7-4c1f-a6c3-2c1a8364b164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:52.416929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8c949-0cf7-4c1f-a6c3-2c1a8364b164 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:52.427188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1260/2515] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:18:52.466344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:53.009739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:54.554356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:54.557271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:54.657895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0dbcc-5bb1-4fe0-8e12-2d6296ade22d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:54.663784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:54.665434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:54.665854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:54.666133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] PATH_INFO: `/v3/users/8c1be8ccf2f14e55a5f22d4c944c6c06` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:54.667352 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1be8ccf2f14e55a5f22d4c944c6c06)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:54.670013 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:54.922002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1be8ccf2f14e55a5f22d4c944c6c06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:54.922906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1be8ccf2f14e55a5f22d4c944c6c06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:54.923854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1be8ccf2f14e55a5f22d4c944c6c06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:54.945596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1be8ccf2f14e55a5f22d4c944c6c06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:54.957487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-84542171-b5e9-4818-834e-caba4b005490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1be8ccf2f14e55a5f22d4c944c6c06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:54.959953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:55.112773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1256/2516] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:18:54 2022] DELETE /identity/v3/users/8c1be8ccf2f14e55a5f22d4c944c6c06 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:55.428437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8c949-0cf7-4c1f-a6c3-2c1a8364b164 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:55.440879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8c949-0cf7-4c1f-a6c3-2c1a8364b164 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:55.504626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:55.505620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:55.505965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:55.506327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] PATH_INFO: `/v3/projects/d261461e12e34816a03c05f278fd6251` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:55.507699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d261461e12e34816a03c05f278fd6251)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:55.509738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:55.674861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd261461e12e34816a03c05f278fd6251', 'request_id': 'req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:55.776532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd261461e12e34816a03c05f278fd6251', 'request_id': 'req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:55.789385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd261461e12e34816a03c05f278fd6251', 'request_id': 'req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:55.804624 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] The token cache is being invalidate because project d261461e12e34816a03c05f278fd6251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:18:55.804913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:55.805662 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b08c40d6-c9a5-4d6d-a1e2-ddd5859702a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:18:55.824536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1261/2517] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:18:55 2022] DELETE /identity/v3/projects/d261461e12e34816a03c05f278fd6251 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:55.830306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc30f-2cee-4f27-8040-aeac728b268b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:55.830852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc30f-2cee-4f27-8040-aeac728b268b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:55.831044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc30f-2cee-4f27-8040-aeac728b268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:55.863720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fe3cc30f-2cee-4f27-8040-aeac728b268b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:55.866612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fe3cc30f-2cee-4f27-8040-aeac728b268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:55.952474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1257/2518] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:55.963616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420efccf-a0a4-40ab-bab3-eae94348ef6d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:55.963900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420efccf-a0a4-40ab-bab3-eae94348ef6d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:55.964171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420efccf-a0a4-40ab-bab3-eae94348ef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:56.028495 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-420efccf-a0a4-40ab-bab3-eae94348ef6d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:56.033853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-420efccf-a0a4-40ab-bab3-eae94348ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:56.042776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1262/2519] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:56.047436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cc30f-2cee-4f27-8040-aeac728b268b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:56.058562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cc30f-2cee-4f27-8040-aeac728b268b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:56.077160 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:56.078996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:56.078996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:56.078996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:56.079245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:18:56.079431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:56.086245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:56.110655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1258/2520] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:18:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:18:56.112507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420efccf-a0a4-40ab-bab3-eae94348ef6d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:56.123187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420efccf-a0a4-40ab-bab3-eae94348ef6d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:56.137557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578f0d-0fbf-4dcf-9769-691ae12ec0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:56.138442 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578f0d-0fbf-4dcf-9769-691ae12ec0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:56.138876 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578f0d-0fbf-4dcf-9769-691ae12ec0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:56.147027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578f0d-0fbf-4dcf-9769-691ae12ec0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:56.147027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578f0d-0fbf-4dcf-9769-691ae12ec0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:56.147027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578f0d-0fbf-4dcf-9769-691ae12ec0fa admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:56.169586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:56.292323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1263/2521] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:18:56 2022] POST /identity/v3/projects => generated 380 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:56.297771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:56.318777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9159f9-4b94-45b9-9078-d553be69bc07 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:56.410277 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493e6d4-5db5-4a8b-a486-3237dcaee913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:56.411066 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493e6d4-5db5-4a8b-a486-3237dcaee913 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:56.411425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493e6d4-5db5-4a8b-a486-3237dcaee913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:56.412758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493e6d4-5db5-4a8b-a486-3237dcaee913 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:56.413562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493e6d4-5db5-4a8b-a486-3237dcaee913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:56.415771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493e6d4-5db5-4a8b-a486-3237dcaee913 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:56.576129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1259/2522] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:18:56 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:56.581577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578f0d-0fbf-4dcf-9769-691ae12ec0fa admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:56.597416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578f0d-0fbf-4dcf-9769-691ae12ec0fa admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:56.603619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d855745-869a-49b6-9c13-95d040fee2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:56.604679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855745-869a-49b6-9c13-95d040fee2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:56.605344 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855745-869a-49b6-9c13-95d040fee2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:56.605886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855745-869a-49b6-9c13-95d040fee2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:56.606839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d855745-869a-49b6-9c13-95d040fee2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:56.610016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d855745-869a-49b6-9c13-95d040fee2a6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:56.635277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1264/2523] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:56 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:18:56.640278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493e6d4-5db5-4a8b-a486-3237dcaee913 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:56.654011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493e6d4-5db5-4a8b-a486-3237dcaee913 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:56.661956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c95d86-4a55-46db-9e74-edba6ae2ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:56.662756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95d86-4a55-46db-9e74-edba6ae2ce6e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:56.663088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95d86-4a55-46db-9e74-edba6ae2ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:56.663426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95d86-4a55-46db-9e74-edba6ae2ce6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:56.664321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c95d86-4a55-46db-9e74-edba6ae2ce6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:56.666236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c95d86-4a55-46db-9e74-edba6ae2ce6e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:56.696580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d855745-869a-49b6-9c13-95d040fee2a6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:56.708208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1260/2524] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:56 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:56.711596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d855745-869a-49b6-9c13-95d040fee2a6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:56.720362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2cf8-bb2b-4af5-bc9f-cb3bb1b2208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:56.722121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2cf8-bb2b-4af5-bc9f-cb3bb1b2208b admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:56.722478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2cf8-bb2b-4af5-bc9f-cb3bb1b2208b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:56.722817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2cf8-bb2b-4af5-bc9f-cb3bb1b2208b admin admin] PATH_INFO: `/v3/projects/144a529d6b32409f87a74fdad4dfc40f/users/27695185d88f4e129ca711688ca10d82/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:56.746080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2cf8-bb2b-4af5-bc9f-cb3bb1b2208b admin admin] RBAC: Authorizing `identity:create_grant(project_id=144a529d6b32409f87a74fdad4dfc40f, user_id=27695185d88f4e129ca711688ca10d82, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:56.749760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2cf8-bb2b-4af5-bc9f-cb3bb1b2208b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:56.867230 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1265/2525] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:56 2022] PUT /identity/v3/projects/144a529d6b32409f87a74fdad4dfc40f/users/27695185d88f4e129ca711688ca10d82/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:56.883465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259ca8-51f0-4c52-8344-bea0463dc780 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:56.883968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259ca8-51f0-4c52-8344-bea0463dc780 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:56.884052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259ca8-51f0-4c52-8344-bea0463dc780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:56.944249 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d4259ca8-51f0-4c52-8344-bea0463dc780 None None] MFA Rules not processed for user `27695185d88f4e129ca711688ca10d82`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:56.953374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d4259ca8-51f0-4c52-8344-bea0463dc780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:57.035444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:57.071944 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1261/2526] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:57.081847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2cf8-bb2b-4af5-bc9f-cb3bb1b2208b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:57.206648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2cf8-bb2b-4af5-bc9f-cb3bb1b2208b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:57.213533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c91c87-5137-4280-bf5e-1df842ac5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:57.215781 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c91c87-5137-4280-bf5e-1df842ac5ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:57.215911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c91c87-5137-4280-bf5e-1df842ac5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:57.216656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c91c87-5137-4280-bf5e-1df842ac5ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:57.216964 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c91c87-5137-4280-bf5e-1df842ac5ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:57.219600 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c91c87-5137-4280-bf5e-1df842ac5ab9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:57.367418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259ca8-51f0-4c52-8344-bea0463dc780 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:57.370592 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1266/2527] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:18:57 2022] POST /identity/v3/projects => generated 378 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:57.380987 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259ca8-51f0-4c52-8344-bea0463dc780 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:57.499986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9cf56-7c9b-4c7e-a9c5-918b34564d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:57.501350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cf56-7c9b-4c7e-a9c5-918b34564d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:57.501805 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cf56-7c9b-4c7e-a9c5-918b34564d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:57.502301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cf56-7c9b-4c7e-a9c5-918b34564d64 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:57.503481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9cf56-7c9b-4c7e-a9c5-918b34564d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:57.506102 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9cf56-7c9b-4c7e-a9c5-918b34564d64 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:57.634067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1262/2528] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:18:57 2022] POST /identity/v3/users => generated 296 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:18:57.638848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c91c87-5137-4280-bf5e-1df842ac5ab9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:57.660896 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c91c87-5137-4280-bf5e-1df842ac5ab9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:57.667369 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d44a0-8407-4e18-ab5b-1d8da12183bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:57.668059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d44a0-8407-4e18-ab5b-1d8da12183bb admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:57.669065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d44a0-8407-4e18-ab5b-1d8da12183bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:57.669421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d44a0-8407-4e18-ab5b-1d8da12183bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:57.672288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d44a0-8407-4e18-ab5b-1d8da12183bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:57.676335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d44a0-8407-4e18-ab5b-1d8da12183bb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:57.703470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9cf56-7c9b-4c7e-a9c5-918b34564d64 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:57.714937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1267/2529] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:57 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:57.720961 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9cf56-7c9b-4c7e-a9c5-918b34564d64 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:57.730759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426ebe7-b3d2-47bd-a0bb-fe31dc906b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:57.732025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ebe7-b3d2-47bd-a0bb-fe31dc906b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:57.732636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ebe7-b3d2-47bd-a0bb-fe31dc906b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:57.733096 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ebe7-b3d2-47bd-a0bb-fe31dc906b40 admin admin] PATH_INFO: `/v3/projects/a6d464a540054eb9b5cfa8a1a085db73/users/9a6661f76ac6416a99b4f01dd3724b88/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:57.763315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426ebe7-b3d2-47bd-a0bb-fe31dc906b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d464a540054eb9b5cfa8a1a085db73, user_id=9a6661f76ac6416a99b4f01dd3724b88, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:57.767571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426ebe7-b3d2-47bd-a0bb-fe31dc906b40 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:57.865615 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d44a0-8407-4e18-ab5b-1d8da12183bb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:57.868409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1263/2530] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:57 2022] PUT /identity/v3/projects/a6d464a540054eb9b5cfa8a1a085db73/users/9a6661f76ac6416a99b4f01dd3724b88/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:57.879215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d44a0-8407-4e18-ab5b-1d8da12183bb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:57.951001 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6114e-0542-4320-8356-ade8b12fe4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:57.951210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6114e-0542-4320-8356-ade8b12fe4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:57.951467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6114e-0542-4320-8356-ade8b12fe4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:57.951779 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6114e-0542-4320-8356-ade8b12fe4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:57.952690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6114e-0542-4320-8356-ade8b12fe4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:57.954313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6114e-0542-4320-8356-ade8b12fe4c2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:57.971034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1268/2531] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:18:57 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:18:57.973614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426ebe7-b3d2-47bd-a0bb-fe31dc906b40 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:57.985998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426ebe7-b3d2-47bd-a0bb-fe31dc906b40 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:57.993003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:57.994356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:57.994844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:57.995893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] PATH_INFO: `/v3/projects/a6d464a540054eb9b5cfa8a1a085db73/users/9a6661f76ac6416a99b4f01dd3724b88/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:57.999175 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d464a540054eb9b5cfa8a1a085db73, user_id=9a6661f76ac6416a99b4f01dd3724b88, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:58.002844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:58.026581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1264/2532] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:18:57 2022] PUT /identity/v3/projects/a6d464a540054eb9b5cfa8a1a085db73/users/9a6661f76ac6416a99b4f01dd3724b88/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:18:58.038847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963675a-9d83-4650-a376-eeaa50e828ab None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:58.039189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963675a-9d83-4650-a376-eeaa50e828ab None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:58.039400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963675a-9d83-4650-a376-eeaa50e828ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:58.078107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0963675a-9d83-4650-a376-eeaa50e828ab None None] MFA Rules not processed for user `9a6661f76ac6416a99b4f01dd3724b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:58.078107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0963675a-9d83-4650-a376-eeaa50e828ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:58.107990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:58.210483 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1269/2533] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:58.218289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:58.220170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:58.319719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb662a-8491-4a2d-a8b3-e3d1a659aac5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:58.323701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:58.324476 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:58.324765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:58.325049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:58.401969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:58.403815 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:58.415440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1265/2534] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:58.647435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:59.388322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5618-cb73-4c04-aa9d-491cfd0cc01d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:59.388807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5618-cb73-4c04-aa9d-491cfd0cc01d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:59.389210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5618-cb73-4c04-aa9d-491cfd0cc01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:59.420544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2a1a5618-cb73-4c04-aa9d-491cfd0cc01d None None] MFA Rules not processed for user `2c1ab8e813de4d19ba05cd752d95b8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:18:59.421767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2a1a5618-cb73-4c04-aa9d-491cfd0cc01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:59.506588 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1270/2535] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:18:59.523655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:18:59.525689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:59.599915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eaf57-a0e3-4ab3-b808-7a6b877889ef service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:18:59.605168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a2c87f8db748ba9264b141f059aab9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:18:59.606134 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:59.606570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:59.606927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:18:59.609413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:18:59.685161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:18:59.687126 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:18:59.700592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1266/2536] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:18:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:18:59.996823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7ab86-b410-4dc6-80d9-ddb363545fc9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:18:59.997126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7ab86-b410-4dc6-80d9-ddb363545fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:18:59.997392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7ab86-b410-4dc6-80d9-ddb363545fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:00.016511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f8f7ab86-b410-4dc6-80d9-ddb363545fc9 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:00.017822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f8f7ab86-b410-4dc6-80d9-ddb363545fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:00.080382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1271/2537] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:00.103000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:00.104458 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:00.178718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694cc0-91f6-41c7-aa87-4f38bb65d408 service glance] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:00.183949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:00.184621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:00.196515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:00.196515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:00.196515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:00.196964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:00.205744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1267/2538] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:19:00.320065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7ab86-b410-4dc6-80d9-ddb363545fc9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:00.321514 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f8f7ab86-b410-4dc6-80d9-ddb363545fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:00.334610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7ab86-b410-4dc6-80d9-ddb363545fc9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:00.350536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821d10f-6e3c-4cbb-9229-b845c279ffbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:00.351253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d10f-6e3c-4cbb-9229-b845c279ffbe service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:00.351540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d10f-6e3c-4cbb-9229-b845c279ffbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:00.351810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d10f-6e3c-4cbb-9229-b845c279ffbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:00.362528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821d10f-6e3c-4cbb-9229-b845c279ffbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:00.364699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821d10f-6e3c-4cbb-9229-b845c279ffbe service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:00.376806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1272/2539] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:02.535548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:02.538536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:02.644107 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:02.734430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ad59d-1a36-47e7-bb2d-85f40dda9a0d service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:02.740922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:02.742216 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:02.742501 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:02.742771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] PATH_INFO: `/v3/users/4a44a18c4f034d5493600265de2039c1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:02.745424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a44a18c4f034d5493600265de2039c1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:02.747430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:03.027673 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a44a18c4f034d5493600265de2039c1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:03.028918 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a44a18c4f034d5493600265de2039c1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:03.030634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a44a18c4f034d5493600265de2039c1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:03.063576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a44a18c4f034d5493600265de2039c1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:03.079357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a44a18c4f034d5493600265de2039c1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:03.168227 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1268/2540] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:02 2022] DELETE /identity/v3/users/4a44a18c4f034d5493600265de2039c1 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:03.172705 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74be63-c9ef-44cc-8ac5-50613015fff3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:03.173219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74be63-c9ef-44cc-8ac5-50613015fff3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:03.173312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74be63-c9ef-44cc-8ac5-50613015fff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:03.202575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7e74be63-c9ef-44cc-8ac5-50613015fff3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:03.203815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7e74be63-c9ef-44cc-8ac5-50613015fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:03.238716 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:03.319307 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1273/2541] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:03.329590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:03.333459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:03.467969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247b8bd-1938-46f2-accc-2a09cc3c338c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:03.481118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1dcc-fcba-4f05-ad17-7153cffe4d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:03.481894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1dcc-fcba-4f05-ad17-7153cffe4d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:03.484784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1dcc-fcba-4f05-ad17-7153cffe4d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:03.485208 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1dcc-fcba-4f05-ad17-7153cffe4d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:03.505830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1dcc-fcba-4f05-ad17-7153cffe4d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:03.507645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1dcc-fcba-4f05-ad17-7153cffe4d2c service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:03.520891 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1269/2542] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:04.195866 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74be63-c9ef-44cc-8ac5-50613015fff3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:04.196399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7e74be63-c9ef-44cc-8ac5-50613015fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:04.218824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74be63-c9ef-44cc-8ac5-50613015fff3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:04.250650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:04.251459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:04.251923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:04.252387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] PATH_INFO: `/v3/projects/21d8e6dafacd42afb47fb95c036bb5c0` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:04.261828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d8e6dafacd42afb47fb95c036bb5c0)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:04.265924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:04.467956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d8e6dafacd42afb47fb95c036bb5c0', 'request_id': 'req-0d130d6d-aaf4-4743-a877-66d154f24e23'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:04.557561 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d8e6dafacd42afb47fb95c036bb5c0', 'request_id': 'req-0d130d6d-aaf4-4743-a877-66d154f24e23'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:04.571956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d8e6dafacd42afb47fb95c036bb5c0', 'request_id': 'req-0d130d6d-aaf4-4743-a877-66d154f24e23'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:04.593969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] The token cache is being invalidate because project 21d8e6dafacd42afb47fb95c036bb5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:04.593969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:04.597843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:04.600777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1274/2543] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:04 2022] DELETE /identity/v3/projects/21d8e6dafacd42afb47fb95c036bb5c0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:04.604345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1dcc-fcba-4f05-ad17-7153cffe4d2c service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:04.622808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1dcc-fcba-4f05-ad17-7153cffe4d2c service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:04.715060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:04.716047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:04.716292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:04.716616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] PATH_INFO: `/v3/users/9acfda824c3149c48fa151472b302e81` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:04.718442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9acfda824c3149c48fa151472b302e81)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:04.720623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:04.722880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:05.213550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:05.216658 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:05.230874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9acfda824c3149c48fa151472b302e81'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.231647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9acfda824c3149c48fa151472b302e81'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.232142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9acfda824c3149c48fa151472b302e81'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.247450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9acfda824c3149c48fa151472b302e81'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.254143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d130d6d-aaf4-4743-a877-66d154f24e23 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:05.256381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a6b3a4e8-65d6-4be3-bfb7-ce60c15918e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9acfda824c3149c48fa151472b302e81'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.259345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:05.260731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:05.261017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:05.261328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] PATH_INFO: `/v3/users/27695185d88f4e129ca711688ca10d82` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:05.262594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27695185d88f4e129ca711688ca10d82)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:05.272183 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:05.329219 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1270/2544] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:04 2022] DELETE /identity/v3/users/9acfda824c3149c48fa151472b302e81 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:05.528731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27695185d88f4e129ca711688ca10d82'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.529731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27695185d88f4e129ca711688ca10d82'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.530526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27695185d88f4e129ca711688ca10d82'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.563715 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27695185d88f4e129ca711688ca10d82'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.584951 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27695185d88f4e129ca711688ca10d82'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:05.685544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1275/2545] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:05 2022] DELETE /identity/v3/users/27695185d88f4e129ca711688ca10d82 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:05.689020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c1ed-aa91-43f5-a644-95fe8cb01d37 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:05.690650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c1ed-aa91-43f5-a644-95fe8cb01d37 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:05.692565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c1ed-aa91-43f5-a644-95fe8cb01d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:05.726900 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aad6c1ed-aa91-43f5-a644-95fe8cb01d37 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:05.728383 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aad6c1ed-aa91-43f5-a644-95fe8cb01d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:05.812292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1271/2546] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:05.828920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:05.830751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:05.864844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6c1ed-aa91-43f5-a644-95fe8cb01d37 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:05.866452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aad6c1ed-aa91-43f5-a644-95fe8cb01d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:05.885154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:05.887118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6c1ed-aa91-43f5-a644-95fe8cb01d37 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:05.893991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:05.895525 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:05.896083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:05.896599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] PATH_INFO: `/v3/projects/db7842943ddf46eb8be5de1b39c10fa7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:05.898044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7842943ddf46eb8be5de1b39c10fa7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:05.900401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:05.963713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3571b17-7c6b-4d1e-b0c4-e64d5831d492 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:05.967879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73f8b5-afd4-44ee-b26c-5dac0c3f8628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:05.968855 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f8b5-afd4-44ee-b26c-5dac0c3f8628 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:05.969311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f8b5-afd4-44ee-b26c-5dac0c3f8628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:05.969739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73f8b5-afd4-44ee-b26c-5dac0c3f8628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:05.982099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73f8b5-afd4-44ee-b26c-5dac0c3f8628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:05.986334 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73f8b5-afd4-44ee-b26c-5dac0c3f8628 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:06.001236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1276/2547] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:06.064269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7842943ddf46eb8be5de1b39c10fa7', 'request_id': 'req-be4d9716-2287-4982-99f9-fca3ec2aebd7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:06.186141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7842943ddf46eb8be5de1b39c10fa7', 'request_id': 'req-be4d9716-2287-4982-99f9-fca3ec2aebd7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:06.194452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7842943ddf46eb8be5de1b39c10fa7', 'request_id': 'req-be4d9716-2287-4982-99f9-fca3ec2aebd7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:06.210441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] The token cache is being invalidate because project db7842943ddf46eb8be5de1b39c10fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:06.210736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:06.211416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-be4d9716-2287-4982-99f9-fca3ec2aebd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:06.216355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1272/2548] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:05 2022] DELETE /identity/v3/projects/db7842943ddf46eb8be5de1b39c10fa7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:06.218450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8d43-cea2-4404-8215-e2ef5814c732 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:06.219016 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8d43-cea2-4404-8215-e2ef5814c732 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:06.219157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d8d43-cea2-4404-8215-e2ef5814c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:06.254018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-758d8d43-cea2-4404-8215-e2ef5814c732 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:06.256062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-758d8d43-cea2-4404-8215-e2ef5814c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:06.380044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1277/2549] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:06.386697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2d88-4463-4462-a8fd-aa26f5affcca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:06.387104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2d88-4463-4462-a8fd-aa26f5affcca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:06.387474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec2d88-4463-4462-a8fd-aa26f5affcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:06.396060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:06.412129 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-28ec2d88-4463-4462-a8fd-aa26f5affcca None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:06.414201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-28ec2d88-4463-4462-a8fd-aa26f5affcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:06.428747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1273/2550] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:06.430829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d8d43-cea2-4404-8215-e2ef5814c732 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:06.445599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d8d43-cea2-4404-8215-e2ef5814c732 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:06.451770 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:06.453161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:06.453642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:06.454082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:06.458712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:06.458712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:06.458712 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:06.476004 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1278/2551] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:19:06.480407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2d88-4463-4462-a8fd-aa26f5affcca None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:06.490760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec2d88-4463-4462-a8fd-aa26f5affcca None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:06.495852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72772e-e634-487d-9a4a-41083a589605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:06.496678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72772e-e634-487d-9a4a-41083a589605 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:06.497075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72772e-e634-487d-9a4a-41083a589605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:06.497443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72772e-e634-487d-9a4a-41083a589605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:06.498244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72772e-e634-487d-9a4a-41083a589605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:06.500287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72772e-e634-487d-9a4a-41083a589605 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:06.621209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1274/2552] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:06 2022] POST /identity/v3/projects => generated 372 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:06.622373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:06.645628 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a6f2a-0019-4bf2-b018-da52a9652ac2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:06.763700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:06.765044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:06.765674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:06.766230 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:06.767209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:06.771300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:06.897054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72772e-e634-487d-9a4a-41083a589605 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:06.897627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1279/2553] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:06 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:06.921651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72772e-e634-487d-9a4a-41083a589605 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:06.941676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:06.943450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451c083-53b7-4a65-bca9-0018874077f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:06.943610 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:06.944149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451c083-53b7-4a65-bca9-0018874077f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:06.944470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451c083-53b7-4a65-bca9-0018874077f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:06.945063 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451c083-53b7-4a65-bca9-0018874077f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:06.946235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451c083-53b7-4a65-bca9-0018874077f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:06.948054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451c083-53b7-4a65-bca9-0018874077f3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:06.970716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1275/2554] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:06 2022] GET /identity/v3/roles => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:06.974243 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451c083-53b7-4a65-bca9-0018874077f3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:06.982100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebafd8d-0b44-4334-ace9-61c713bb26e9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:06.987758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451c083-53b7-4a65-bca9-0018874077f3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:06.988147 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:06.989597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:06.989963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:06.990408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] PATH_INFO: `/v3/projects/144a529d6b32409f87a74fdad4dfc40f` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:06.991875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=144a529d6b32409f87a74fdad4dfc40f)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:06.993795 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400a244-0aec-472c-bdfc-b1c3bba9e9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:06.994300 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:06.994634 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400a244-0aec-472c-bdfc-b1c3bba9e9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:06.995138 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400a244-0aec-472c-bdfc-b1c3bba9e9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:06.996075 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400a244-0aec-472c-bdfc-b1c3bba9e9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:06.997079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400a244-0aec-472c-bdfc-b1c3bba9e9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:07.000141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400a244-0aec-472c-bdfc-b1c3bba9e9ab admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:07.018264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1276/2555] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:06 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:19:07.020275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400a244-0aec-472c-bdfc-b1c3bba9e9ab admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:07.031419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400a244-0aec-472c-bdfc-b1c3bba9e9ab admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:07.039332 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc9be6-ec96-4093-b1cd-a2ca274564ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:07.041705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9be6-ec96-4093-b1cd-a2ca274564ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:07.044120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9be6-ec96-4093-b1cd-a2ca274564ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:07.044120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9be6-ec96-4093-b1cd-a2ca274564ba admin admin] PATH_INFO: `/v3/projects/2fd90415b8004cc9b53200e03c076440/users/23f5b6dab7214b589078aa95ab5eb95b/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:07.090122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc9be6-ec96-4093-b1cd-a2ca274564ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd90415b8004cc9b53200e03c076440, user_id=23f5b6dab7214b589078aa95ab5eb95b, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:07.095016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc9be6-ec96-4093-b1cd-a2ca274564ba admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:07.108172 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:07.118371 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144a529d6b32409f87a74fdad4dfc40f', 'request_id': 'req-2f515b84-9b17-464e-9440-aae97dc9ca8e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.203580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144a529d6b32409f87a74fdad4dfc40f', 'request_id': 'req-2f515b84-9b17-464e-9440-aae97dc9ca8e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.210379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1277/2556] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:07 2022] PUT /identity/v3/projects/2fd90415b8004cc9b53200e03c076440/users/23f5b6dab7214b589078aa95ab5eb95b/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:07.220661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328893-de66-4e72-a68c-7d555696aae4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:07.221185 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328893-de66-4e72-a68c-7d555696aae4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:07.227094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328893-de66-4e72-a68c-7d555696aae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:07.227234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144a529d6b32409f87a74fdad4dfc40f', 'request_id': 'req-2f515b84-9b17-464e-9440-aae97dc9ca8e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.239360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] The token cache is being invalidate because project 144a529d6b32409f87a74fdad4dfc40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:07.239798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.240769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.243714 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1280/2557] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:06 2022] DELETE /identity/v3/projects/144a529d6b32409f87a74fdad4dfc40f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:07.249665 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:07.251981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:07.271540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-52328893-de66-4e72-a68c-7d555696aae4 None None] MFA Rules not processed for user `23f5b6dab7214b589078aa95ab5eb95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:07.273091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-52328893-de66-4e72-a68c-7d555696aae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:07.384210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f515b84-9b17-464e-9440-aae97dc9ca8e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:07.401847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1278/2558] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:07.406222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52328893-de66-4e72-a68c-7d555696aae4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:07.407665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-52328893-de66-4e72-a68c-7d555696aae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:07.513124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52328893-de66-4e72-a68c-7d555696aae4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:07.514580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:07.516708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:07.516965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:07.517315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] PATH_INFO: `/v3/users/9a6661f76ac6416a99b4f01dd3724b88` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:07.518939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6661f76ac6416a99b4f01dd3724b88)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:07.521283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:07.523265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66c4c-7ffb-4d42-9a2e-d22fe1ee7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:07.524295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66c4c-7ffb-4d42-9a2e-d22fe1ee7abc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:07.524758 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66c4c-7ffb-4d42-9a2e-d22fe1ee7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:07.525366 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66c4c-7ffb-4d42-9a2e-d22fe1ee7abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:07.526668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66c4c-7ffb-4d42-9a2e-d22fe1ee7abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:07.528421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66c4c-7ffb-4d42-9a2e-d22fe1ee7abc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:07.640798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1279/2559] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:07 2022] POST /identity/v3/projects => generated 374 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:07.642684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66c4c-7ffb-4d42-9a2e-d22fe1ee7abc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:07.650299 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:07.729048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66c4c-7ffb-4d42-9a2e-d22fe1ee7abc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:07.734380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:07.735052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:07.735340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:07.735617 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:07.736324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:07.738963 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:07.803727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6661f76ac6416a99b4f01dd3724b88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.804625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6661f76ac6416a99b4f01dd3724b88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.805445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6661f76ac6416a99b4f01dd3724b88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.831577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6661f76ac6416a99b4f01dd3724b88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.838869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1280/2560] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:07 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:07.838869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:07.845692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6661f76ac6416a99b4f01dd3724b88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:07.847779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:07.858033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:07.868471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ece19d-7845-4038-9bc1-4d8024027165 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:07.874863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cf2d7-bb9a-43d5-949d-720c3ad47653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:07.875766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cf2d7-bb9a-43d5-949d-720c3ad47653 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:07.876215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cf2d7-bb9a-43d5-949d-720c3ad47653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:07.876498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cf2d7-bb9a-43d5-949d-720c3ad47653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:07.877321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cf2d7-bb9a-43d5-949d-720c3ad47653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:07.879735 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cf2d7-bb9a-43d5-949d-720c3ad47653 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:07.892349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1281/2561] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:07 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:19:07.895947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cf2d7-bb9a-43d5-949d-720c3ad47653 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:07.907252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cf2d7-bb9a-43d5-949d-720c3ad47653 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:07.917764 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2cc3e-f301-432b-ab40-7df1afc5a292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:07.918907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2cc3e-f301-432b-ab40-7df1afc5a292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:07.925452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2cc3e-f301-432b-ab40-7df1afc5a292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:07.925452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2cc3e-f301-432b-ab40-7df1afc5a292 admin admin] PATH_INFO: `/v3/projects/c861b91c74cc45a9a9f4ad4dd13de2b1/users/0e6bcdbcb34544a6a022f08f7c0b3b37/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:07.939189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2cc3e-f301-432b-ab40-7df1afc5a292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c861b91c74cc45a9a9f4ad4dd13de2b1, user_id=0e6bcdbcb34544a6a022f08f7c0b3b37, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:07.942524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2cc3e-f301-432b-ab40-7df1afc5a292 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:07.956062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1281/2562] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:07 2022] DELETE /identity/v3/users/9a6661f76ac6416a99b4f01dd3724b88 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:08.069043 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1282/2563] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:07 2022] PUT /identity/v3/projects/c861b91c74cc45a9a9f4ad4dd13de2b1/users/0e6bcdbcb34544a6a022f08f7c0b3b37/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:08.069626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:08.145774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252ebf3-18f1-413f-8c24-ecae9848e3fd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:08.233296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3472b-3ef9-4f87-babb-c2aea39021f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:08.233974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3472b-3ef9-4f87-babb-c2aea39021f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:08.234257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3472b-3ef9-4f87-babb-c2aea39021f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:08.234528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3472b-3ef9-4f87-babb-c2aea39021f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:08.235255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3472b-3ef9-4f87-babb-c2aea39021f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:08.239480 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3472b-3ef9-4f87-babb-c2aea39021f6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:08.250802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1282/2564] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:08 2022] GET /identity/v3/roles => generated 1427 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:08.261279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2cc3e-f301-432b-ab40-7df1afc5a292 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:08.273939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2cc3e-f301-432b-ab40-7df1afc5a292 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:08.290125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:08.291438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:08.292026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:08.292540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] PATH_INFO: `/v3/projects/c861b91c74cc45a9a9f4ad4dd13de2b1/users/0e6bcdbcb34544a6a022f08f7c0b3b37/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:08.305279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c861b91c74cc45a9a9f4ad4dd13de2b1, user_id=0e6bcdbcb34544a6a022f08f7c0b3b37, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:08.309682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:08.325846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1283/2565] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:08 2022] PUT /identity/v3/projects/c861b91c74cc45a9a9f4ad4dd13de2b1/users/0e6bcdbcb34544a6a022f08f7c0b3b37/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:08.342638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6ae25-1c4f-490d-a539-0db23f02bf81 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:08.342930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6ae25-1c4f-490d-a539-0db23f02bf81 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:08.343201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6ae25-1c4f-490d-a539-0db23f02bf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:08.373068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5ed6ae25-1c4f-490d-a539-0db23f02bf81 None None] MFA Rules not processed for user `0e6bcdbcb34544a6a022f08f7c0b3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:08.374308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5ed6ae25-1c4f-490d-a539-0db23f02bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:08.473425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1283/2566] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:08.488712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:08.490675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6ae25-1c4f-490d-a539-0db23f02bf81 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:08.491959 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:08.492895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5ed6ae25-1c4f-490d-a539-0db23f02bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:08.543243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:08.600777 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd903f-24a9-4159-a334-39db2aaeac57 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:08.605290 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f881b8-2eae-4536-86ec-67e33201fb1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:08.606273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f881b8-2eae-4536-86ec-67e33201fb1b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:08.606686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f881b8-2eae-4536-86ec-67e33201fb1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:08.606931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f881b8-2eae-4536-86ec-67e33201fb1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:08.611235 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6ae25-1c4f-490d-a539-0db23f02bf81 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:08.617794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:08.624411 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f881b8-2eae-4536-86ec-67e33201fb1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:08.624580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:08.624580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:08.624580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] PATH_INFO: `/v3/projects/a6d464a540054eb9b5cfa8a1a085db73` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:08.624824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f881b8-2eae-4536-86ec-67e33201fb1b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:08.624921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d464a540054eb9b5cfa8a1a085db73)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:08.624921 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:08.631867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1284/2567] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:09.192758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d464a540054eb9b5cfa8a1a085db73', 'request_id': 'req-8b31f2f1-79e4-446e-a65d-7f1c961614f3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:09.247025 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d464a540054eb9b5cfa8a1a085db73', 'request_id': 'req-8b31f2f1-79e4-446e-a65d-7f1c961614f3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:09.256368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d464a540054eb9b5cfa8a1a085db73', 'request_id': 'req-8b31f2f1-79e4-446e-a65d-7f1c961614f3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:09.266209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] The token cache is being invalidate because project a6d464a540054eb9b5cfa8a1a085db73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:09.266499 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:09.267152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8b31f2f1-79e4-446e-a65d-7f1c961614f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:09.272670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1284/2568] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:08 2022] DELETE /identity/v3/projects/a6d464a540054eb9b5cfa8a1a085db73 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:09.274880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b47d-ffab-4fab-9a5f-0769eece5fc1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:09.275327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b47d-ffab-4fab-9a5f-0769eece5fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:09.275435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88b47d-ffab-4fab-9a5f-0769eece5fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:09.301977 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1b88b47d-ffab-4fab-9a5f-0769eece5fc1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:09.303448 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1b88b47d-ffab-4fab-9a5f-0769eece5fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:09.382095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:09.407073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1285/2569] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:09.415642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c7d92-3f67-40ee-98c3-4fd42233f019 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:09.415976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c7d92-3f67-40ee-98c3-4fd42233f019 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:09.416345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c7d92-3f67-40ee-98c3-4fd42233f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:09.442565 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a64c7d92-3f67-40ee-98c3-4fd42233f019 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:09.443893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a64c7d92-3f67-40ee-98c3-4fd42233f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:09.456507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1285/2570] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:09.459344 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88b47d-ffab-4fab-9a5f-0769eece5fc1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:09.474008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88b47d-ffab-4fab-9a5f-0769eece5fc1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:09.480417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:09.481463 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:09.481782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:09.482892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:09.483570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:09.483905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:09.486099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:09.505317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1286/2571] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:09.510009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c7d92-3f67-40ee-98c3-4fd42233f019 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:09.520986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c7d92-3f67-40ee-98c3-4fd42233f019 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:09.527333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5438fd8-5ae9-4aff-85ff-f4e961006a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:09.528013 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438fd8-5ae9-4aff-85ff-f4e961006a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:09.528311 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438fd8-5ae9-4aff-85ff-f4e961006a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:09.528605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5438fd8-5ae9-4aff-85ff-f4e961006a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:09.529449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5438fd8-5ae9-4aff-85ff-f4e961006a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:09.531408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5438fd8-5ae9-4aff-85ff-f4e961006a0f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:09.664174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1286/2572] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:09 2022] POST /identity/v3/projects => generated 380 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:09.667042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:09.678922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a11ef-04ba-4cbd-b294-514806a38fd5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:09.781514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a89e2-b78e-498a-a1fd-be767f4d5a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:09.782209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a89e2-b78e-498a-a1fd-be767f4d5a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:09.782483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a89e2-b78e-498a-a1fd-be767f4d5a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:09.782855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a89e2-b78e-498a-a1fd-be767f4d5a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:09.783937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a89e2-b78e-498a-a1fd-be767f4d5a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:09.786572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a89e2-b78e-498a-a1fd-be767f4d5a7e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:09.905224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1287/2573] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:09 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:09.910359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5438fd8-5ae9-4aff-85ff-f4e961006a0f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:09.928152 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5438fd8-5ae9-4aff-85ff-f4e961006a0f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:09.933760 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d0e2c-fa14-47d8-8984-d6fdf21c15d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:09.934614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0e2c-fa14-47d8-8984-d6fdf21c15d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:09.935012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0e2c-fa14-47d8-8984-d6fdf21c15d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:09.935385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0e2c-fa14-47d8-8984-d6fdf21c15d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:09.936437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d0e2c-fa14-47d8-8984-d6fdf21c15d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:09.938161 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d0e2c-fa14-47d8-8984-d6fdf21c15d8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:09.956522 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1287/2574] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:09.957695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a89e2-b78e-498a-a1fd-be767f4d5a7e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:09.971090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a89e2-b78e-498a-a1fd-be767f4d5a7e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:09.977151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e6708-d199-403d-9dc8-f74bfe8689fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:09.977817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6708-d199-403d-9dc8-f74bfe8689fc admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:09.978099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6708-d199-403d-9dc8-f74bfe8689fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:09.978372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6708-d199-403d-9dc8-f74bfe8689fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:09.979100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e6708-d199-403d-9dc8-f74bfe8689fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:09.980790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e6708-d199-403d-9dc8-f74bfe8689fc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:09.996342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1288/2575] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:09 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:09.999324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d0e2c-fa14-47d8-8984-d6fdf21c15d8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:10.013156 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d0e2c-fa14-47d8-8984-d6fdf21c15d8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:10.019671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:10.028376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.028376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.028376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] PATH_INFO: `/v3/projects/085cdba4bc2a4bd6a6b208c7ee004ae7/users/8da2a5d435b540c9b3005ca8a211104d/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.041408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=085cdba4bc2a4bd6a6b208c7ee004ae7, user_id=8da2a5d435b540c9b3005ca8a211104d, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:10.044142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:10.134902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1288/2576] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:09 2022] PUT /identity/v3/projects/085cdba4bc2a4bd6a6b208c7ee004ae7/users/8da2a5d435b540c9b3005ca8a211104d/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:10.147947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6194a9-bfab-45c9-9143-27b84f78be43 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.148238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6194a9-bfab-45c9-9143-27b84f78be43 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.148608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6194a9-bfab-45c9-9143-27b84f78be43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.185252 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4a6194a9-bfab-45c9-9143-27b84f78be43 None None] MFA Rules not processed for user `8da2a5d435b540c9b3005ca8a211104d`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:10.186538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4a6194a9-bfab-45c9-9143-27b84f78be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:10.193864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:10.197048 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:10.269614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:10.288343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1289/2577] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:10.292852 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6194a9-bfab-45c9-9143-27b84f78be43 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:10.297485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d565a-0346-4e0f-84b7-b014c232c1bd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:10.308036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:10.308966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.309247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.309523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] PATH_INFO: `/v3/users/23f5b6dab7214b589078aa95ab5eb95b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.313271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f5b6dab7214b589078aa95ab5eb95b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:10.315294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:10.318737 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6194a9-bfab-45c9-9143-27b84f78be43 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:10.326022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9705-4597-4b44-9c2c-b02088ad1cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:10.326689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9705-4597-4b44-9c2c-b02088ad1cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.326975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9705-4597-4b44-9c2c-b02088ad1cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.327254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9705-4597-4b44-9c2c-b02088ad1cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.327955 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc9705-4597-4b44-9c2c-b02088ad1cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:10.330452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc9705-4597-4b44-9c2c-b02088ad1cfc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:10.494029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1290/2578] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:10 2022] POST /identity/v3/projects => generated 382 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:10.495203 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9705-4597-4b44-9c2c-b02088ad1cfc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:10.522423 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:10.590279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9705-4597-4b44-9c2c-b02088ad1cfc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:10.595609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60616e4-ad68-421a-a94a-632500367e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:10.597125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60616e4-ad68-421a-a94a-632500367e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.597470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60616e4-ad68-421a-a94a-632500367e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.597833 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60616e4-ad68-421a-a94a-632500367e7b admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.598603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60616e4-ad68-421a-a94a-632500367e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:10.601013 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60616e4-ad68-421a-a94a-632500367e7b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:10.606000 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f5b6dab7214b589078aa95ab5eb95b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:10.606730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f5b6dab7214b589078aa95ab5eb95b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:10.607550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f5b6dab7214b589078aa95ab5eb95b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:10.624787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f5b6dab7214b589078aa95ab5eb95b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:10.632454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f5b6dab7214b589078aa95ab5eb95b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:10.782667 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1289/2579] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:10 2022] DELETE /identity/v3/users/23f5b6dab7214b589078aa95ab5eb95b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:10.786178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:10.786178 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:10.787638 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1291/2580] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:10 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:10.789316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a1e1-d7aa-4c97-ba1d-d846007bb781 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.789761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a1e1-d7aa-4c97-ba1d-d846007bb781 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.790349 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a1e1-d7aa-4c97-ba1d-d846007bb781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.816563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f555a1e1-d7aa-4c97-ba1d-d846007bb781 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:10.819885 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f555a1e1-d7aa-4c97-ba1d-d846007bb781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:10.884752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a40a-81f7-4ac4-acfe-e97e7eb4349a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:10.888788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:10.889633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.890033 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.890617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.893110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:10.900204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1292/2581] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:10.902365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a1e1-d7aa-4c97-ba1d-d846007bb781 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:10.912522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f555a1e1-d7aa-4c97-ba1d-d846007bb781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:10.915606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:10.917089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:10.927403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a1e1-d7aa-4c97-ba1d-d846007bb781 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:10.932229 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee60ff5-e286-4001-a8e9-0fa99d0e1afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:10.933137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60ff5-e286-4001-a8e9-0fa99d0e1afd admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.933281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1290/2582] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:10.933372 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60ff5-e286-4001-a8e9-0fa99d0e1afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.933583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60ff5-e286-4001-a8e9-0fa99d0e1afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.934280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee60ff5-e286-4001-a8e9-0fa99d0e1afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:10.934553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:10.936100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:10.936220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee60ff5-e286-4001-a8e9-0fa99d0e1afd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:10.952296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a83182-5d3a-40ef-9f29-eafe70e474ed service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:10.961202 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1293/2583] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:10 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:10.962961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7034249-c0b5-49b2-b439-a5f91a09b572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:10.963627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034249-c0b5-49b2-b439-a5f91a09b572 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.963905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034249-c0b5-49b2-b439-a5f91a09b572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.964181 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034249-c0b5-49b2-b439-a5f91a09b572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:10.965300 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee60ff5-e286-4001-a8e9-0fa99d0e1afd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:10.978141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee60ff5-e286-4001-a8e9-0fa99d0e1afd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:10.980024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7034249-c0b5-49b2-b439-a5f91a09b572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:10.981539 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7034249-c0b5-49b2-b439-a5f91a09b572 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:10.984633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f27d-4c40-400f-bd14-bfe9a429f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:10.991657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f27d-4c40-400f-bd14-bfe9a429f50a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:10.991657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f27d-4c40-400f-bd14-bfe9a429f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:10.991657 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f27d-4c40-400f-bd14-bfe9a429f50a admin admin] PATH_INFO: `/v3/projects/251522a1349f444daefa2ae004467231/users/84267a7e14894c2abb1c09a8c77c118d/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:11.011601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1291/2584] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:11.013112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f27d-4c40-400f-bd14-bfe9a429f50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=251522a1349f444daefa2ae004467231, user_id=84267a7e14894c2abb1c09a8c77c118d, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:11.016527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f27d-4c40-400f-bd14-bfe9a429f50a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:11.102689 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1294/2585] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:10 2022] PUT /identity/v3/projects/251522a1349f444daefa2ae004467231/users/84267a7e14894c2abb1c09a8c77c118d/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:11.106894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7034249-c0b5-49b2-b439-a5f91a09b572 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:11.122978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7034249-c0b5-49b2-b439-a5f91a09b572 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:11.211859 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:11.219787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f069fb-0a4b-485b-a704-02159322f240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:11.220949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f069fb-0a4b-485b-a704-02159322f240 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:11.221454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f069fb-0a4b-485b-a704-02159322f240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:11.222261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f069fb-0a4b-485b-a704-02159322f240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:11.223143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f069fb-0a4b-485b-a704-02159322f240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:11.225288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f069fb-0a4b-485b-a704-02159322f240 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:11.260294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f27d-4c40-400f-bd14-bfe9a429f50a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:11.261105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1292/2586] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:11 2022] GET /identity/v3/roles => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:11.276906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f27d-4c40-400f-bd14-bfe9a429f50a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:11.280496 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:11.281676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:11.282174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:11.282670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] PATH_INFO: `/v3/projects/251522a1349f444daefa2ae004467231/users/84267a7e14894c2abb1c09a8c77c118d/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:11.287594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251522a1349f444daefa2ae004467231, user_id=84267a7e14894c2abb1c09a8c77c118d, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:11.291583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:11.325988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1295/2587] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:11 2022] PUT /identity/v3/projects/251522a1349f444daefa2ae004467231/users/84267a7e14894c2abb1c09a8c77c118d/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:11.337977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e287d7e-dfb0-4339-8be5-05c1895fdaf9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:11.338506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e287d7e-dfb0-4339-8be5-05c1895fdaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:11.338506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e287d7e-dfb0-4339-8be5-05c1895fdaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:11.396158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3e287d7e-dfb0-4339-8be5-05c1895fdaf9 None None] MFA Rules not processed for user `84267a7e14894c2abb1c09a8c77c118d`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:11.397568 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3e287d7e-dfb0-4339-8be5-05c1895fdaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:11.546692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1293/2588] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:11.561896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:11.564072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:11.624802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e287d7e-dfb0-4339-8be5-05c1895fdaf9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:11.626243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3e287d7e-dfb0-4339-8be5-05c1895fdaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:11.694168 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad989c-d7f4-4a96-a325-5ecb2a5ea926 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:11.701667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bd79-3ba8-441e-99e3-e6b35aa39bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:11.702484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bd79-3ba8-441e-99e3-e6b35aa39bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:11.702836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bd79-3ba8-441e-99e3-e6b35aa39bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:11.703530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4bd79-3ba8-441e-99e3-e6b35aa39bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:11.718065 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4bd79-3ba8-441e-99e3-e6b35aa39bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:11.719632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4bd79-3ba8-441e-99e3-e6b35aa39bc1 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:11.725771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e287d7e-dfb0-4339-8be5-05c1895fdaf9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:11.731070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:11.732162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:11.732638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:11.733068 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1296/2589] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:19:11.733228 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] PATH_INFO: `/v3/projects/2fd90415b8004cc9b53200e03c076440` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:11.734707 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd90415b8004cc9b53200e03c076440)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:11.736833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:11.928637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd90415b8004cc9b53200e03c076440', 'request_id': 'req-87d5be70-87be-4ef0-85ea-a5efa2ee074f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.050596 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd90415b8004cc9b53200e03c076440', 'request_id': 'req-87d5be70-87be-4ef0-85ea-a5efa2ee074f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.060246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd90415b8004cc9b53200e03c076440', 'request_id': 'req-87d5be70-87be-4ef0-85ea-a5efa2ee074f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.078223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] The token cache is being invalidate because project 2fd90415b8004cc9b53200e03c076440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:12.078769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.079829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.082848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1294/2590] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:11 2022] DELETE /identity/v3/projects/2fd90415b8004cc9b53200e03c076440 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:12.086664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bd79-3ba8-441e-99e3-e6b35aa39bc1 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:12.094421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:12.099741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4bd79-3ba8-441e-99e3-e6b35aa39bc1 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:12.284853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:12.285698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:12.285980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:12.286254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] PATH_INFO: `/v3/users/0e6bcdbcb34544a6a022f08f7c0b3b37` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:12.287546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6bcdbcb34544a6a022f08f7c0b3b37)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:12.289540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:12.467472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:12.470879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:12.491609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5be70-87be-4ef0-85ea-a5efa2ee074f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:12.516930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:12.522212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:12.522212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:12.522212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] PATH_INFO: `/v3/users/8da2a5d435b540c9b3005ca8a211104d` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:12.522212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da2a5d435b540c9b3005ca8a211104d)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:12.522212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:12.525416 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:12.707137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6bcdbcb34544a6a022f08f7c0b3b37'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.708896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6bcdbcb34544a6a022f08f7c0b3b37'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.709914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6bcdbcb34544a6a022f08f7c0b3b37'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.737576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6bcdbcb34544a6a022f08f7c0b3b37'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.746004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-90776c69-5895-4f95-a81a-d9ce2d5f8b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6bcdbcb34544a6a022f08f7c0b3b37'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.876061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da2a5d435b540c9b3005ca8a211104d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.876860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da2a5d435b540c9b3005ca8a211104d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.900175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da2a5d435b540c9b3005ca8a211104d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.900175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da2a5d435b540c9b3005ca8a211104d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:12.904098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da2a5d435b540c9b3005ca8a211104d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:13.062840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1297/2591] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:12 2022] DELETE /identity/v3/users/0e6bcdbcb34544a6a022f08f7c0b3b37 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:13.154815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1295/2592] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:12 2022] DELETE /identity/v3/users/8da2a5d435b540c9b3005ca8a211104d => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:13.156697 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ee64-870e-4838-b572-c8e83a5a725f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:13.157170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ee64-870e-4838-b572-c8e83a5a725f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:13.157596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ee64-870e-4838-b572-c8e83a5a725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:13.188818 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bc53ee64-870e-4838-b572-c8e83a5a725f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:13.192401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bc53ee64-870e-4838-b572-c8e83a5a725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:13.278494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1298/2593] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:13.293212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:13.296448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:13.473846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3860d-6123-43f5-8fd0-c291dc2e44df admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:13.480830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db17af-7320-4c1c-a1dc-130e93617bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:13.481640 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db17af-7320-4c1c-a1dc-130e93617bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:13.481989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db17af-7320-4c1c-a1dc-130e93617bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:13.482330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db17af-7320-4c1c-a1dc-130e93617bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:13.500636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db17af-7320-4c1c-a1dc-130e93617bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:13.502469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db17af-7320-4c1c-a1dc-130e93617bd8 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:13.514889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1296/2594] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:13.746255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53ee64-870e-4838-b572-c8e83a5a725f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:13.747665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bc53ee64-870e-4838-b572-c8e83a5a725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:13.771278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53ee64-870e-4838-b572-c8e83a5a725f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:13.775851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:13.776806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:13.777089 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:13.777367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] PATH_INFO: `/v3/projects/c861b91c74cc45a9a9f4ad4dd13de2b1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:13.778901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c861b91c74cc45a9a9f4ad4dd13de2b1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:13.784667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:13.837620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:13.957345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c861b91c74cc45a9a9f4ad4dd13de2b1', 'request_id': 'req-36c5f8d6-c639-4475-8c89-a07c46892dd2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.032906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c861b91c74cc45a9a9f4ad4dd13de2b1', 'request_id': 'req-36c5f8d6-c639-4475-8c89-a07c46892dd2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.044165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c861b91c74cc45a9a9f4ad4dd13de2b1', 'request_id': 'req-36c5f8d6-c639-4475-8c89-a07c46892dd2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.072547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] The token cache is being invalidate because project c861b91c74cc45a9a9f4ad4dd13de2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:14.072841 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.073542 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.080595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1299/2595] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:13 2022] DELETE /identity/v3/projects/c861b91c74cc45a9a9f4ad4dd13de2b1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:14.082528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8940f-d220-49ae-9a39-e514ad975fa1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.083107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8940f-d220-49ae-9a39-e514ad975fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.083636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8940f-d220-49ae-9a39-e514ad975fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.141931 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-33a8940f-d220-49ae-9a39-e514ad975fa1 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:14.143971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-33a8940f-d220-49ae-9a39-e514ad975fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:14.220759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:14.223422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:14.303211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1297/2596] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:14.309849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221af377-2c5e-41d7-8463-0b56fed17110 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.310296 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221af377-2c5e-41d7-8463-0b56fed17110 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.310650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221af377-2c5e-41d7-8463-0b56fed17110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.321470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5f8d6-c639-4475-8c89-a07c46892dd2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:14.329025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:14.330164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.330614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.331623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] PATH_INFO: `/v3/projects/085cdba4bc2a4bd6a6b208c7ee004ae7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.333191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=085cdba4bc2a4bd6a6b208c7ee004ae7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:14.335816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:14.336456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-221af377-2c5e-41d7-8463-0b56fed17110 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:14.337955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-221af377-2c5e-41d7-8463-0b56fed17110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:14.352026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1298/2597] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:14.356264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221af377-2c5e-41d7-8463-0b56fed17110 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:14.369189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221af377-2c5e-41d7-8463-0b56fed17110 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:14.375021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:14.375870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.376236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.376597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.377517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:14.378542 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:14.380955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:14.399438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1299/2598] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:19:14.400487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:14.406720 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:14.410545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe399be8-b66d-49d0-a5a8-5b6a9d8c184c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:14.415343 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f14850-6f5c-4fbe-ab2c-23562d0e6f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:14.416005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14850-6f5c-4fbe-ab2c-23562d0e6f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.416288 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14850-6f5c-4fbe-ab2c-23562d0e6f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.416597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14850-6f5c-4fbe-ab2c-23562d0e6f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.417284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f14850-6f5c-4fbe-ab2c-23562d0e6f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:14.419224 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f14850-6f5c-4fbe-ab2c-23562d0e6f93 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:14.510616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085cdba4bc2a4bd6a6b208c7ee004ae7', 'request_id': 'req-623af322-a633-41dd-9fa1-85edee39c74a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.575576 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1300/2599] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:14 2022] POST /identity/v3/projects => generated 380 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:14.579613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f14850-6f5c-4fbe-ab2c-23562d0e6f93 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:14.649771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f14850-6f5c-4fbe-ab2c-23562d0e6f93 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:14.654990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:14.655673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.657481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.657481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.657481 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:14.660275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:14.679611 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085cdba4bc2a4bd6a6b208c7ee004ae7', 'request_id': 'req-623af322-a633-41dd-9fa1-85edee39c74a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.696197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085cdba4bc2a4bd6a6b208c7ee004ae7', 'request_id': 'req-623af322-a633-41dd-9fa1-85edee39c74a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.714368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] The token cache is being invalidate because project 085cdba4bc2a4bd6a6b208c7ee004ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:14.714755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.715824 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:14.720345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1300/2600] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:14 2022] DELETE /identity/v3/projects/085cdba4bc2a4bd6a6b208c7ee004ae7 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:14.722690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:14.726357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:14.763259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1301/2601] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:14 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:14.768246 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:14.771789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:14.782211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:14.808528 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af322-a633-41dd-9fa1-85edee39c74a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:14.814419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:14.815843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.816178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.816515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] PATH_INFO: `/v3/users/84267a7e14894c2abb1c09a8c77c118d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.817889 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84267a7e14894c2abb1c09a8c77c118d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:14.820442 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:14.824842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f47d7-bde4-4d50-83fd-9420edf9149b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:14.834813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95d225-d4bc-45bb-ab70-66f287025337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:14.836106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d225-d4bc-45bb-ab70-66f287025337 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.836613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d225-d4bc-45bb-ab70-66f287025337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.837118 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95d225-d4bc-45bb-ab70-66f287025337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.843730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95d225-d4bc-45bb-ab70-66f287025337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:14.846107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95d225-d4bc-45bb-ab70-66f287025337 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:14.863762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1302/2602] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:14 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:19:14.868163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95d225-d4bc-45bb-ab70-66f287025337 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:14.882683 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95d225-d4bc-45bb-ab70-66f287025337 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:14.888127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd21fd6-bf77-4ebd-84ce-2dd4cb183c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:14.888973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd21fd6-bf77-4ebd-84ce-2dd4cb183c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.889310 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd21fd6-bf77-4ebd-84ce-2dd4cb183c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.889660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd21fd6-bf77-4ebd-84ce-2dd4cb183c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.890465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd21fd6-bf77-4ebd-84ce-2dd4cb183c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:14.892153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd21fd6-bf77-4ebd-84ce-2dd4cb183c87 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:14.903454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1303/2603] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:14 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:19:14.907860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd21fd6-bf77-4ebd-84ce-2dd4cb183c87 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:14.920151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd21fd6-bf77-4ebd-84ce-2dd4cb183c87 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:14.925703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f2f6b-3c64-4026-b979-01c310166c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:14.926611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f2f6b-3c64-4026-b979-01c310166c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:14.927144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f2f6b-3c64-4026-b979-01c310166c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:14.927421 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f2f6b-3c64-4026-b979-01c310166c85 admin admin] PATH_INFO: `/v3/projects/ec1b8a8ae2f24300a98c2ff186f61006/users/93d8fcfebda74914b1b66cdb217c1419/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:14.945566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f2f6b-3c64-4026-b979-01c310166c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1b8a8ae2f24300a98c2ff186f61006, user_id=93d8fcfebda74914b1b66cdb217c1419, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:14.949387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f2f6b-3c64-4026-b979-01c310166c85 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:15.024517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84267a7e14894c2abb1c09a8c77c118d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:15.025198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84267a7e14894c2abb1c09a8c77c118d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:15.025784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84267a7e14894c2abb1c09a8c77c118d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:15.038712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84267a7e14894c2abb1c09a8c77c118d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:15.045750 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f5285115-1ec7-4dd5-bf79-e0479c8d822f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84267a7e14894c2abb1c09a8c77c118d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:15.105526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1304/2604] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:14 2022] PUT /identity/v3/projects/ec1b8a8ae2f24300a98c2ff186f61006/users/93d8fcfebda74914b1b66cdb217c1419/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:15.107531 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6185b-bfd8-476d-988f-bcbcaf28ed60 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:15.107901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6185b-bfd8-476d-988f-bcbcaf28ed60 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:15.108696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6185b-bfd8-476d-988f-bcbcaf28ed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:15.136052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6bd6185b-bfd8-476d-988f-bcbcaf28ed60 None None] MFA Rules not processed for user `7f86adaf1fff4b94b2911633b61adefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:15.137293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1301/2605] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:14 2022] DELETE /identity/v3/users/84267a7e14894c2abb1c09a8c77c118d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:15.138238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6bd6185b-bfd8-476d-988f-bcbcaf28ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:15.142136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1ad80-bca8-4993-adc7-d9306ea9fd49 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:15.142432 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1ad80-bca8-4993-adc7-d9306ea9fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:15.142716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1ad80-bca8-4993-adc7-d9306ea9fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:15.191327 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7bb1ad80-bca8-4993-adc7-d9306ea9fd49 None None] MFA Rules not processed for user `93d8fcfebda74914b1b66cdb217c1419`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:15.194239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7bb1ad80-bca8-4993-adc7-d9306ea9fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:15.244447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1305/2606] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:15.314007 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1302/2607] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:15.319131 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6185b-bfd8-476d-988f-bcbcaf28ed60 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:15.320621 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6bd6185b-bfd8-476d-988f-bcbcaf28ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:15.459455 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6185b-bfd8-476d-988f-bcbcaf28ed60 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:15.466132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:15.470450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:15.470450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:15.470450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:15.470450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:15.470450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:15.597248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1ad80-bca8-4993-adc7-d9306ea9fd49 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:15.603444 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1306/2608] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:15 2022] POST /identity/v3/projects => generated 380 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:15.614668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1ad80-bca8-4993-adc7-d9306ea9fd49 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:15.700941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499899-8d96-43fd-a1f2-6d0ae90b86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:15.701616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499899-8d96-43fd-a1f2-6d0ae90b86c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:15.701904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499899-8d96-43fd-a1f2-6d0ae90b86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:15.702165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499899-8d96-43fd-a1f2-6d0ae90b86c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:15.703212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f499899-8d96-43fd-a1f2-6d0ae90b86c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:15.705380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f499899-8d96-43fd-a1f2-6d0ae90b86c4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:15.762910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:15.816726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:15.819258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:15.823082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1303/2609] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:15 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:15.824844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499899-8d96-43fd-a1f2-6d0ae90b86c4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:15.835786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499899-8d96-43fd-a1f2-6d0ae90b86c4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:15.843108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dad5d-b80e-46b6-98fd-754eb5398649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:15.844043 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dad5d-b80e-46b6-98fd-754eb5398649 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:15.844621 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dad5d-b80e-46b6-98fd-754eb5398649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:15.850931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dad5d-b80e-46b6-98fd-754eb5398649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:15.850931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dad5d-b80e-46b6-98fd-754eb5398649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:15.850931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dad5d-b80e-46b6-98fd-754eb5398649 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:15.881648 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1304/2610] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:15 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:15.883058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dad5d-b80e-46b6-98fd-754eb5398649 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:15.894148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dad5d-b80e-46b6-98fd-754eb5398649 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:15.903573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd611e-8321-4b2b-a7f7-d111cac84dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:15.905043 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd611e-8321-4b2b-a7f7-d111cac84dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:15.905329 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd611e-8321-4b2b-a7f7-d111cac84dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:15.905600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd611e-8321-4b2b-a7f7-d111cac84dfe admin admin] PATH_INFO: `/v3/projects/3f976dd7e0df481db1d6d23c58ce83d7/users/c361111a11f14207a38a34520c971ef5/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:15.915427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b817f-89e0-4db6-a26f-84449c49125a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:15.919648 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:15.926690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:15.926690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:15.926690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:15.926690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:15.927498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd611e-8321-4b2b-a7f7-d111cac84dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f976dd7e0df481db1d6d23c58ce83d7, user_id=c361111a11f14207a38a34520c971ef5, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:15.928493 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd611e-8321-4b2b-a7f7-d111cac84dfe admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:15.935325 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:15.936631 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:15.946902 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1307/2611] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:15.948219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:15.949752 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:15.966427 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cabdb-7f3f-4c54-939e-1a64e4e20038 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:15.971074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:15.972986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:15.973494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:15.973939 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] PATH_INFO: `/v3/projects/251522a1349f444daefa2ae004467231` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:15.975509 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251522a1349f444daefa2ae004467231)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:15.976473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:15.977647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.020222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1305/2612] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:15 2022] PUT /identity/v3/projects/3f976dd7e0df481db1d6d23c58ce83d7/users/c361111a11f14207a38a34520c971ef5/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:16.023973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd611e-8321-4b2b-a7f7-d111cac84dfe admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.090703 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd611e-8321-4b2b-a7f7-d111cac84dfe admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:16.108809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251522a1349f444daefa2ae004467231', 'request_id': 'req-6c03cc07-c390-492a-a84d-880683167bd4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.162559 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:16.163153 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.163437 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.163713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.164474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:16.166090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.176171 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1306/2613] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:16 2022] GET /identity/v3/roles => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:19:16.177450 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.181142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.188008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251522a1349f444daefa2ae004467231', 'request_id': 'req-6c03cc07-c390-492a-a84d-880683167bd4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.200120 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251522a1349f444daefa2ae004467231', 'request_id': 'req-6c03cc07-c390-492a-a84d-880683167bd4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.213971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] The token cache is being invalidate because project 251522a1349f444daefa2ae004467231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:16.214348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.215566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.217906 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1308/2614] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:15 2022] DELETE /identity/v3/projects/251522a1349f444daefa2ae004467231 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:16.222212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.223816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.237315 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03cc07-c390-492a-a84d-880683167bd4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:16.242387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:16.243264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.243547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.243824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] PATH_INFO: `/v3/projects/3f976dd7e0df481db1d6d23c58ce83d7/users/c361111a11f14207a38a34520c971ef5/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.245843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f976dd7e0df481db1d6d23c58ce83d7, user_id=c361111a11f14207a38a34520c971ef5, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:16.248541 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.261867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1309/2615] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:16 2022] PUT /identity/v3/projects/3f976dd7e0df481db1d6d23c58ce83d7/users/c361111a11f14207a38a34520c971ef5/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:16.272004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76a64-499f-4cfe-8d18-20b8d0af9b59 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:16.273373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.276463 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.340655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef138c2c-1a0c-4f11-af55-34aa3cfdc1b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:16.341380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef138c2c-1a0c-4f11-af55-34aa3cfdc1b1 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.341668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef138c2c-1a0c-4f11-af55-34aa3cfdc1b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.341943 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef138c2c-1a0c-4f11-af55-34aa3cfdc1b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.343838 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ef138c2c-1a0c-4f11-af55-34aa3cfdc1b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.350974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90effab-bbee-4f12-8b20-6c093fad9105 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:16.355696 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef138c2c-1a0c-4f11-af55-34aa3cfdc1b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:16.356904 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:16.357351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef138c2c-1a0c-4f11-af55-34aa3cfdc1b1 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.358422 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.358953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.359460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] PATH_INFO: `/v3/users/ebdb2f4338f842f19f1cba1be13597c5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.361637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebdb2f4338f842f19f1cba1be13597c5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:16.365512 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.368499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1307/2616] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:16.370236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ec0a-f2e8-464a-84fb-0d0b69ab9e03 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.370236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ec0a-f2e8-464a-84fb-0d0b69ab9e03 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.370236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ec0a-f2e8-464a-84fb-0d0b69ab9e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.389555 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a820ec0a-f2e8-464a-84fb-0d0b69ab9e03 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:16.392998 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a820ec0a-f2e8-464a-84fb-0d0b69ab9e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.399700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1308/2617] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:16.401008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82076a46-a071-4a2b-a262-0a4f6ca59de7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.401294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82076a46-a071-4a2b-a262-0a4f6ca59de7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.401566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82076a46-a071-4a2b-a262-0a4f6ca59de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.429682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-82076a46-a071-4a2b-a262-0a4f6ca59de7 None None] MFA Rules not processed for user `c361111a11f14207a38a34520c971ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:16.430927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-82076a46-a071-4a2b-a262-0a4f6ca59de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.510041 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1309/2618] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:16.511686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50dfc0-da22-49c5-9d02-b7006069f0d3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.512085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50dfc0-da22-49c5-9d02-b7006069f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.512503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50dfc0-da22-49c5-9d02-b7006069f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.533453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0f50dfc0-da22-49c5-9d02-b7006069f0d3 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:16.535347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0f50dfc0-da22-49c5-9d02-b7006069f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.543586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1310/2619] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:16.544418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50dfc0-da22-49c5-9d02-b7006069f0d3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.545664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0f50dfc0-da22-49c5-9d02-b7006069f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.567775 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebdb2f4338f842f19f1cba1be13597c5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.568981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebdb2f4338f842f19f1cba1be13597c5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.569674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebdb2f4338f842f19f1cba1be13597c5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.587201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebdb2f4338f842f19f1cba1be13597c5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.594577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebdb2f4338f842f19f1cba1be13597c5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:16.627222 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50dfc0-da22-49c5-9d02-b7006069f0d3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:16.631783 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:16.632484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.632763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.633039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.634854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.650575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:16.650575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.660119 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1311/2620] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:16.661031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.662426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:16.677706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410f0dd-bf48-4f68-b0a4-5bc08416cbfe service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:16.682302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:16.683606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.683606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.683606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.684317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:16.684698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:16.686326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.702239 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1312/2621] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:16.704925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.715744 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1310/2622] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:16 2022] DELETE /identity/v3/users/ebdb2f4338f842f19f1cba1be13597c5 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:16.716233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c011aa-85b5-4cfc-ba75-b32c4f534bc7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:16.728091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:16.780594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:16.781259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.781597 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.781877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.782592 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:16.784782 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.877728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1313/2623] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:16 2022] POST /identity/v3/projects => generated 382 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:16.881910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.892941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45f5e2-4bc8-4995-ac0d-21eaf75960ab admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:16.953403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a643f88-9d10-4abd-af68-08f7b51908d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:16.954075 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643f88-9d10-4abd-af68-08f7b51908d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:16.954351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643f88-9d10-4abd-af68-08f7b51908d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:16.954727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643f88-9d10-4abd-af68-08f7b51908d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:16.955497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a643f88-9d10-4abd-af68-08f7b51908d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:16.958002 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a643f88-9d10-4abd-af68-08f7b51908d8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:16.989100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:16.990875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:17.011361 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb9381-8d91-44e3-bdc4-7f230b201365 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.021489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.021489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.021489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.021489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] PATH_INFO: `/v3/projects/7e572c2dccfb4d57a35e31cecd041e11` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.022273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e572c2dccfb4d57a35e31cecd041e11)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.024209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.095867 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1311/2624] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:16 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:17.100545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a643f88-9d10-4abd-af68-08f7b51908d8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.110448 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a643f88-9d10-4abd-af68-08f7b51908d8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.115787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f0402-5317-4ddb-ab89-459f5d376b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.116593 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f0402-5317-4ddb-ab89-459f5d376b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.116833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f0402-5317-4ddb-ab89-459f5d376b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.117459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f0402-5317-4ddb-ab89-459f5d376b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.118170 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f0402-5317-4ddb-ab89-459f5d376b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.119927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f0402-5317-4ddb-ab89-459f5d376b7b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.141711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1312/2625] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:17 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:19:17.141919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e572c2dccfb4d57a35e31cecd041e11', 'request_id': 'req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:17.146305 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f0402-5317-4ddb-ab89-459f5d376b7b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.157485 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f0402-5317-4ddb-ab89-459f5d376b7b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.219086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5ab6d-118a-4163-be77-7169d670b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.219753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab6d-118a-4163-be77-7169d670b3af admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.220035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab6d-118a-4163-be77-7169d670b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.220328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab6d-118a-4163-be77-7169d670b3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.221059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5ab6d-118a-4163-be77-7169d670b3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.223417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5ab6d-118a-4163-be77-7169d670b3af admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.233597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1313/2626] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:17 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:17.237925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5ab6d-118a-4163-be77-7169d670b3af admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.247323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e572c2dccfb4d57a35e31cecd041e11', 'request_id': 'req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:17.247726 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5ab6d-118a-4163-be77-7169d670b3af admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.252502 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead75359-9a95-4786-8120-ed28b85c8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.256584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75359-9a95-4786-8120-ed28b85c8c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.256584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75359-9a95-4786-8120-ed28b85c8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.256584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75359-9a95-4786-8120-ed28b85c8c92 admin admin] PATH_INFO: `/v3/projects/b65ba3e04a474524b563ff05614421af/users/97b1b5d4c1f7466083effc7a0c207759/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.256894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e572c2dccfb4d57a35e31cecd041e11', 'request_id': 'req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:17.265082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] The token cache is being invalidate because project 7e572c2dccfb4d57a35e31cecd041e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:17.265366 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:17.266028 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5be11bee-eb80-414e-9ce0-a88f46ce4cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:17.267594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1314/2627] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:16 2022] DELETE /identity/v3/projects/7e572c2dccfb4d57a35e31cecd041e11 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:17.273031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936f30-d8be-496a-81d5-0d40abc90d19 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.273323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936f30-d8be-496a-81d5-0d40abc90d19 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.273435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead75359-9a95-4786-8120-ed28b85c8c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65ba3e04a474524b563ff05614421af, user_id=97b1b5d4c1f7466083effc7a0c207759, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.274201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936f30-d8be-496a-81d5-0d40abc90d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.278632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead75359-9a95-4786-8120-ed28b85c8c92 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.295808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-21936f30-d8be-496a-81d5-0d40abc90d19 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:17.297094 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-21936f30-d8be-496a-81d5-0d40abc90d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:17.306337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1315/2628] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:17.313896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62eb5-7b88-48a2-a040-41fb2c4ca27f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.314376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62eb5-7b88-48a2-a040-41fb2c4ca27f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.314662 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62eb5-7b88-48a2-a040-41fb2c4ca27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.333855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-07f62eb5-7b88-48a2-a040-41fb2c4ca27f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:17.335057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-07f62eb5-7b88-48a2-a040-41fb2c4ca27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:17.343112 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1316/2629] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:17.347794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f62eb5-7b88-48a2-a040-41fb2c4ca27f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.356864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f62eb5-7b88-48a2-a040-41fb2c4ca27f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.361773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.362444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.362725 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.363029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.363746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:17.364054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.365893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.377481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1317/2630] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:19:17.382417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.385848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1314/2631] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:17 2022] PUT /identity/v3/projects/b65ba3e04a474524b563ff05614421af/users/97b1b5d4c1f7466083effc7a0c207759/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:17.395766 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad47439-2a2c-4085-85f3-6d413a747980 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.397412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84236-cad7-4092-991d-1c45ca39f40e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.397700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84236-cad7-4092-991d-1c45ca39f40e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.397978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84236-cad7-4092-991d-1c45ca39f40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.411337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:17.434233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a5c84236-cad7-4092-991d-1c45ca39f40e None None] MFA Rules not processed for user `97b1b5d4c1f7466083effc7a0c207759`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:17.435530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a5c84236-cad7-4092-991d-1c45ca39f40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:17.464867 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acc271-d043-4088-a1d7-894c7e1c00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.465524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc271-d043-4088-a1d7-894c7e1c00f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.465810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc271-d043-4088-a1d7-894c7e1c00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.466084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc271-d043-4088-a1d7-894c7e1c00f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.466802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acc271-d043-4088-a1d7-894c7e1c00f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.468811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acc271-d043-4088-a1d7-894c7e1c00f6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.509808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1315/2632] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:17.514242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c84236-cad7-4092-991d-1c45ca39f40e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.515591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a5c84236-cad7-4092-991d-1c45ca39f40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:17.529972 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c84236-cad7-4092-991d-1c45ca39f40e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.535441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f62ee3-96a6-48dd-aed7-f354401dcab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.536087 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f62ee3-96a6-48dd-aed7-f354401dcab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.536401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f62ee3-96a6-48dd-aed7-f354401dcab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.536678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f62ee3-96a6-48dd-aed7-f354401dcab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.537362 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f62ee3-96a6-48dd-aed7-f354401dcab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.539342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f62ee3-96a6-48dd-aed7-f354401dcab0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.664473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1318/2633] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:17 2022] POST /identity/v3/projects => generated 372 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:17.665484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acc271-d043-4088-a1d7-894c7e1c00f6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.694308 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1316/2634] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:17 2022] POST /identity/v3/projects => generated 380 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:17.698356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f62ee3-96a6-48dd-aed7-f354401dcab0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.732523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acc271-d043-4088-a1d7-894c7e1c00f6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.770241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f62ee3-96a6-48dd-aed7-f354401dcab0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.778256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2400f-ee81-4c4f-9a2a-c114840e94c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.778256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2400f-ee81-4c4f-9a2a-c114840e94c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.778256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2400f-ee81-4c4f-9a2a-c114840e94c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.778256 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2400f-ee81-4c4f-9a2a-c114840e94c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.778669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2400f-ee81-4c4f-9a2a-c114840e94c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.780920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2400f-ee81-4c4f-9a2a-c114840e94c6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.797583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.798343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.798632 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.798908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.799593 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.801636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.934317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1319/2635] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:17 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:17.934317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.934317 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:17.936697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1317/2636] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:17 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:17.937932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2400f-ee81-4c4f-9a2a-c114840e94c6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.950188 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2400f-ee81-4c4f-9a2a-c114840e94c6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.955420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1af2-224e-44ca-9ffd-811c67776bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.956757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1af2-224e-44ca-9ffd-811c67776bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.957080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1af2-224e-44ca-9ffd-811c67776bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.957187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1af2-224e-44ca-9ffd-811c67776bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.957892 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a1af2-224e-44ca-9ffd-811c67776bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.959490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a1af2-224e-44ca-9ffd-811c67776bbf admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.969435 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1318/2637] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:17 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:17.973368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1af2-224e-44ca-9ffd-811c67776bbf admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:17.982842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1af2-224e-44ca-9ffd-811c67776bbf admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:17.988102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92be36-9b83-4b26-b7ac-0794975bfa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:17.988873 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92be36-9b83-4b26-b7ac-0794975bfa0a admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:17.989153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92be36-9b83-4b26-b7ac-0794975bfa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:17.989425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92be36-9b83-4b26-b7ac-0794975bfa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:17.990129 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92be36-9b83-4b26-b7ac-0794975bfa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:17.991791 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92be36-9b83-4b26-b7ac-0794975bfa0a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:17.999581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:18.007527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1319/2638] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:17 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:18.007527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92be36-9b83-4b26-b7ac-0794975bfa0a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.015230 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2023683-1458-4d45-b5bd-4521fed1d4f6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.016971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92be36-9b83-4b26-b7ac-0794975bfa0a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.020120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c361111a11f14207a38a34520c971ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f976dd7e0df481db1d6d23c58ce83d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.020120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.020751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.020751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.021445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:18.021738 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.022035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362df3-3ddb-4ecb-b5d5-95351bab85f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.022681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362df3-3ddb-4ecb-b5d5-95351bab85f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.022960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362df3-3ddb-4ecb-b5d5-95351bab85f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.023229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362df3-3ddb-4ecb-b5d5-95351bab85f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.023418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.023936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09362df3-3ddb-4ecb-b5d5-95351bab85f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.025545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09362df3-3ddb-4ecb-b5d5-95351bab85f1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.035728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1320/2639] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:18.036655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.036807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1320/2640] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:18 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:18.041169 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362df3-3ddb-4ecb-b5d5-95351bab85f1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.047724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228ade5-50d3-47a6-af79-89773d194759 tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.052478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362df3-3ddb-4ecb-b5d5-95351bab85f1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.053281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d97fe-05b8-4dbb-b844-8e40246e978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.054189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d97fe-05b8-4dbb-b844-8e40246e978b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.054883 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d97fe-05b8-4dbb-b844-8e40246e978b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.055183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d97fe-05b8-4dbb-b844-8e40246e978b admin admin] PATH_INFO: `/v3/projects/fe4a8c8d793645c8a3b4e20822d2efe4/users/23c29d658c734d2182cd26ecb7db5254/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.057434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:18.057777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7a214-e98b-42b0-a769-62163c2357ec tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c361111a11f14207a38a34520c971ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f976dd7e0df481db1d6d23c58ce83d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.058423 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a214-e98b-42b0-a769-62163c2357ec tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.058704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a214-e98b-42b0-a769-62163c2357ec tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.058976 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a214-e98b-42b0-a769-62163c2357ec tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.059679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7a214-e98b-42b0-a769-62163c2357ec tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.061674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7a214-e98b-42b0-a769-62163c2357ec tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.072947 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d97fe-05b8-4dbb-b844-8e40246e978b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4a8c8d793645c8a3b4e20822d2efe4, user_id=23c29d658c734d2182cd26ecb7db5254, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.078217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d97fe-05b8-4dbb-b844-8e40246e978b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.181236 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1321/2641] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:18 2022] POST /identity/v3/projects => generated 355 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:18.182096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7a214-e98b-42b0-a769-62163c2357ec tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.208817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1321/2642] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:18 2022] PUT /identity/v3/projects/fe4a8c8d793645c8a3b4e20822d2efe4/users/23c29d658c734d2182cd26ecb7db5254/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:18.210074 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d97fe-05b8-4dbb-b844-8e40246e978b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.248806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7a214-e98b-42b0-a769-62163c2357ec tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.265487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:18.279503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d97fe-05b8-4dbb-b844-8e40246e978b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.285166 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c361111a11f14207a38a34520c971ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f976dd7e0df481db1d6d23c58ce83d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.286162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.286162 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.286364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.287105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:18.287566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.289224 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.460747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156e6c7-624b-4e8e-99bc-64b066642a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.460747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156e6c7-624b-4e8e-99bc-64b066642a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.460747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156e6c7-624b-4e8e-99bc-64b066642a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.460747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156e6c7-624b-4e8e-99bc-64b066642a57 admin admin] PATH_INFO: `/v3/projects/b6cacfb3ffc944f4b091beceefd59923/users/39746d40e51d44819136d84843529680/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.461196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1322/2643] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:18.461196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.461196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7559e-c71a-4bcf-865d-b3146266fafa tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.461470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156e6c7-624b-4e8e-99bc-64b066642a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cacfb3ffc944f4b091beceefd59923, user_id=39746d40e51d44819136d84843529680, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.461470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156e6c7-624b-4e8e-99bc-64b066642a57 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.461668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b768-9a21-4e15-acab-afba8d6d651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.461668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b768-9a21-4e15-acab-afba8d6d651e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.461668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b768-9a21-4e15-acab-afba8d6d651e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.461668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b768-9a21-4e15-acab-afba8d6d651e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.462108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b768-9a21-4e15-acab-afba8d6d651e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.462108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36b768-9a21-4e15-acab-afba8d6d651e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.462108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1323/2644] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:18 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:18.462108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b768-9a21-4e15-acab-afba8d6d651e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.462108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b768-9a21-4e15-acab-afba8d6d651e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.462561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c361111a11f14207a38a34520c971ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f976dd7e0df481db1d6d23c58ce83d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.462561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.462561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.462831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] PATH_INFO: `/v3/projects/77134caabc6c43da887db38cfb22adc8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.462831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Authorizing `identity:delete_project(project_id=77134caabc6c43da887db38cfb22adc8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.462831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.533616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1322/2645] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:18 2022] PUT /identity/v3/projects/b6cacfb3ffc944f4b091beceefd59923/users/39746d40e51d44819136d84843529680/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:18.534666 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156e6c7-624b-4e8e-99bc-64b066642a57 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.547114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77134caabc6c43da887db38cfb22adc8', 'request_id': 'req-45a2c748-9a63-4a2c-9e76-90e294a9e87d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:18.613346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156e6c7-624b-4e8e-99bc-64b066642a57 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.632561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77134caabc6c43da887db38cfb22adc8', 'request_id': 'req-45a2c748-9a63-4a2c-9e76-90e294a9e87d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:18.640080 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77134caabc6c43da887db38cfb22adc8', 'request_id': 'req-45a2c748-9a63-4a2c-9e76-90e294a9e87d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:18.652217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] The token cache is being invalidate because project 77134caabc6c43da887db38cfb22adc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:18.652527 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:18.653204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45a2c748-9a63-4a2c-9e76-90e294a9e87d tempest-VolumeQuotaClassesTest-994606516 tempest-VolumeQuotaClassesTest-994606516-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:18.655333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1324/2646] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:18 2022] DELETE /identity/v3/projects/77134caabc6c43da887db38cfb22adc8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:18.656602 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cea40-d998-4158-8613-b6357d50a697 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.667032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cea40-d998-4158-8613-b6357d50a697 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.667032 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cea40-d998-4158-8613-b6357d50a697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.678536 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408092b-f527-4511-898e-4c4559612930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.679981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408092b-f527-4511-898e-4c4559612930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.680488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408092b-f527-4511-898e-4c4559612930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.680977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408092b-f527-4511-898e-4c4559612930 admin admin] PATH_INFO: `/v3/projects/fe4a8c8d793645c8a3b4e20822d2efe4/users/23c29d658c734d2182cd26ecb7db5254/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.684265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408092b-f527-4511-898e-4c4559612930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4a8c8d793645c8a3b4e20822d2efe4, user_id=23c29d658c734d2182cd26ecb7db5254, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.685321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-075cea40-d998-4158-8613-b6357d50a697 None None] MFA Rules not processed for user `39746d40e51d44819136d84843529680`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:18.687381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-075cea40-d998-4158-8613-b6357d50a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:18.695319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408092b-f527-4511-898e-4c4559612930 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.713408 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1323/2647] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:18 2022] PUT /identity/v3/projects/fe4a8c8d793645c8a3b4e20822d2efe4/users/23c29d658c734d2182cd26ecb7db5254/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:18.730762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479610-78cf-4fd7-b234-835465a40ebb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.731090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479610-78cf-4fd7-b234-835465a40ebb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.731318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479610-78cf-4fd7-b234-835465a40ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.753614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:18.768365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-55479610-78cf-4fd7-b234-835465a40ebb None None] MFA Rules not processed for user `23c29d658c734d2182cd26ecb7db5254`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:18.770124 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1325/2648] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:18.770445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-55479610-78cf-4fd7-b234-835465a40ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:18.785576 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cea40-d998-4158-8613-b6357d50a697 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.787503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-075cea40-d998-4158-8613-b6357d50a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:18.865766 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1324/2649] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:18.870424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cea40-d998-4158-8613-b6357d50a697 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.877559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479610-78cf-4fd7-b234-835465a40ebb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:18.878983 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-55479610-78cf-4fd7-b234-835465a40ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:18.938938 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479610-78cf-4fd7-b234-835465a40ebb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:18.939620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.940357 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.941908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.942192 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.943602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:18.944244 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:18.944557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:18.944961 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:18.954980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:18.956678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:18.961711 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:18.966857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1325/2650] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:19:19.006205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:19.007910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:19.017515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1326/2651] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:19.198790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:19.465566 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:19.467022 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:19.483390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351d4d6-d41d-48ae-8c98-bfc97a0bebc5 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:19.483390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07449b-d1e7-4c70-8d6e-c995d00d3640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:19.483771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07449b-d1e7-4c70-8d6e-c995d00d3640 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:19.484065 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07449b-d1e7-4c70-8d6e-c995d00d3640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:19.484349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07449b-d1e7-4c70-8d6e-c995d00d3640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:19.486262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4b07449b-d1e7-4c70-8d6e-c995d00d3640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:19.535325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:19.548358 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07449b-d1e7-4c70-8d6e-c995d00d3640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:19.550345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07449b-d1e7-4c70-8d6e-c995d00d3640 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:19.560157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1326/2652] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:19:19.605153 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:19.747539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:19.749413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:19.832917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040bfe-60dd-4233-bce8-1f2d543dd30a service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:19.838188 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:19.839196 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:19.839605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:19.839982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] PATH_INFO: `/v3/users/93d8fcfebda74914b1b66cdb217c1419` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:19.841405 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d8fcfebda74914b1b66cdb217c1419)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:19.843485 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:19.909021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b0f13-74b9-430e-a0a5-374e3b12a93d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:19.910258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b0f13-74b9-430e-a0a5-374e3b12a93d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:19.910842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b0f13-74b9-430e-a0a5-374e3b12a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:19.966313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b52b0f13-74b9-430e-a0a5-374e3b12a93d None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:19.967599 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b52b0f13-74b9-430e-a0a5-374e3b12a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:20.046609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1327/2653] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:19:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:20.059532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b0f13-74b9-430e-a0a5-374e3b12a93d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:20.060968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b52b0f13-74b9-430e-a0a5-374e3b12a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:20.091572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d8fcfebda74914b1b66cdb217c1419'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.092649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d8fcfebda74914b1b66cdb217c1419'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.094053 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d8fcfebda74914b1b66cdb217c1419'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.106778 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d8fcfebda74914b1b66cdb217c1419'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.114497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d8fcfebda74914b1b66cdb217c1419'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.143400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b0f13-74b9-430e-a0a5-374e3b12a93d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:20.160798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734f2e4-663d-492f-8b0f-c91de33d5ccc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:20.160798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f2e4-663d-492f-8b0f-c91de33d5ccc service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:20.160798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f2e4-663d-492f-8b0f-c91de33d5ccc service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:20.160798 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f2e4-663d-492f-8b0f-c91de33d5ccc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:20.217543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2734f2e4-663d-492f-8b0f-c91de33d5ccc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:20.217543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734f2e4-663d-492f-8b0f-c91de33d5ccc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:20.217543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734f2e4-663d-492f-8b0f-c91de33d5ccc service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:20.217543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1328/2654] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 18:19:20.278727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1327/2655] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:19 2022] DELETE /identity/v3/users/93d8fcfebda74914b1b66cdb217c1419 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:20.283248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101e23-5349-4231-93ed-1c6676ecf322 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:20.283548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101e23-5349-4231-93ed-1c6676ecf322 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:20.283824 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101e23-5349-4231-93ed-1c6676ecf322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:20.304998 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-41101e23-5349-4231-93ed-1c6676ecf322 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:20.306271 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-41101e23-5349-4231-93ed-1c6676ecf322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:20.340447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:20.382879 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:20.384599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:20.391965 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1329/2656] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:20.409098 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41101e23-5349-4231-93ed-1c6676ecf322 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:20.411166 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-41101e23-5349-4231-93ed-1c6676ecf322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:20.422785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417456-af31-44bd-95c0-1721253b4af8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:20.428507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:20.442618 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:20.445545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:20.445834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:20.446183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] PATH_INFO: `/v3/users/97b1b5d4c1f7466083effc7a0c207759` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:20.451281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b1b5d4c1f7466083effc7a0c207759)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:20.458715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:20.560259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41101e23-5349-4231-93ed-1c6676ecf322 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:20.566623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20b12c-5aca-48a5-aaf4-6fc03f78629d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:20.567368 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b12c-5aca-48a5-aaf4-6fc03f78629d service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:20.567650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b12c-5aca-48a5-aaf4-6fc03f78629d service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:20.567933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b12c-5aca-48a5-aaf4-6fc03f78629d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:20.580612 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20b12c-5aca-48a5-aaf4-6fc03f78629d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:20.582372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20b12c-5aca-48a5-aaf4-6fc03f78629d service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:20.609851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1330/2657] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:20.728142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b1b5d4c1f7466083effc7a0c207759'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.729451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b1b5d4c1f7466083effc7a0c207759'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.730951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b1b5d4c1f7466083effc7a0c207759'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.744386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:20.751919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b1b5d4c1f7466083effc7a0c207759'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.766472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b1b5d4c1f7466083effc7a0c207759'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:20.861605 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc965-8872-4991-83ac-647b7dcead12 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:20.861967 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc965-8872-4991-83ac-647b7dcead12 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:20.862393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc965-8872-4991-83ac-647b7dcead12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:20.866250 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1328/2658] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:20 2022] DELETE /identity/v3/users/97b1b5d4c1f7466083effc7a0c207759 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:20.913511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9b4bc965-8872-4991-83ac-647b7dcead12 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:20.913511 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9b4bc965-8872-4991-83ac-647b7dcead12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:21.049517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1331/2659] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:21.066261 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:21.068156 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:21.179749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b545d-bebb-45b9-abab-c1582f6956dd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:21.184578 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b993ff-a459-4a73-90c4-75f04561e08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:21.185837 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b993ff-a459-4a73-90c4-75f04561e08b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:21.186293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b993ff-a459-4a73-90c4-75f04561e08b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:21.186577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b993ff-a459-4a73-90c4-75f04561e08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:21.217856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b993ff-a459-4a73-90c4-75f04561e08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:21.222857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b993ff-a459-4a73-90c4-75f04561e08b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:21.230294 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc965-8872-4991-83ac-647b7dcead12 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:21.235352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9b4bc965-8872-4991-83ac-647b7dcead12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:21.297528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc965-8872-4991-83ac-647b7dcead12 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:21.308875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:21.321854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:21.321854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:21.321854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] PATH_INFO: `/v3/projects/ec1b8a8ae2f24300a98c2ff186f61006` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:21.321854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1b8a8ae2f24300a98c2ff186f61006)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:21.321854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:21.322843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1329/2660] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:21.543516 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1b8a8ae2f24300a98c2ff186f61006', 'request_id': 'req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:21.619003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1b8a8ae2f24300a98c2ff186f61006', 'request_id': 'req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:21.630209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1b8a8ae2f24300a98c2ff186f61006', 'request_id': 'req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:21.640690 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:21.646551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] The token cache is being invalidate because project ec1b8a8ae2f24300a98c2ff186f61006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:21.647313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:21.648273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:21.652354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1332/2661] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:21 2022] DELETE /identity/v3/projects/ec1b8a8ae2f24300a98c2ff186f61006 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:21.654193 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b993ff-a459-4a73-90c4-75f04561e08b service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:21.674083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b993ff-a459-4a73-90c4-75f04561e08b service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:21.790975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:21.792619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:21.793176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:21.793682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] PATH_INFO: `/v3/users/c361111a11f14207a38a34520c971ef5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:21.795937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c361111a11f14207a38a34520c971ef5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:21.798381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:22.239473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c361111a11f14207a38a34520c971ef5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.240215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c361111a11f14207a38a34520c971ef5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.241609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c361111a11f14207a38a34520c971ef5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.262026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c361111a11f14207a38a34520c971ef5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.273644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c361111a11f14207a38a34520c971ef5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.277712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:22.350587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:22.360905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:22.395946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511bd10-2ffa-49ff-9e05-7298a43ea8a7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:22.405447 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:22.407414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:22.408680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:22.408989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] PATH_INFO: `/v3/projects/b65ba3e04a474524b563ff05614421af` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:22.413806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65ba3e04a474524b563ff05614421af)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:22.418535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:22.447754 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1330/2662] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:21 2022] DELETE /identity/v3/users/c361111a11f14207a38a34520c971ef5 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:22.671144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65ba3e04a474524b563ff05614421af', 'request_id': 'req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.740067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:22.741661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:22.767846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65ba3e04a474524b563ff05614421af', 'request_id': 'req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.785022 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65ba3e04a474524b563ff05614421af', 'request_id': 'req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.808399 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] The token cache is being invalidate because project b65ba3e04a474524b563ff05614421af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:22.808706 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.814708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:22.817157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1333/2663] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:22 2022] DELETE /identity/v3/projects/b65ba3e04a474524b563ff05614421af => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:22.822414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:22.824010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:22.876877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cf3d5-1b7d-4513-a8a7-f18b3b0ede2f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:22.964245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7a4cf-e622-48a0-8462-cab9d8c63b8b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:22.975262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:22.976217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:22.978232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:22.978550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] PATH_INFO: `/v3/users/23c29d658c734d2182cd26ecb7db5254` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:22.985026 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c29d658c734d2182cd26ecb7db5254)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:22.987144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:23.009447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:23.012695 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:23.013822 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:23.014920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] PATH_INFO: `/v3/users/39746d40e51d44819136d84843529680` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:23.029598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39746d40e51d44819136d84843529680)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:23.031817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:23.318996 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c29d658c734d2182cd26ecb7db5254'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.319745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c29d658c734d2182cd26ecb7db5254'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.320459 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c29d658c734d2182cd26ecb7db5254'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.323875 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39746d40e51d44819136d84843529680'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.328189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39746d40e51d44819136d84843529680'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.328189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39746d40e51d44819136d84843529680'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.336773 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c29d658c734d2182cd26ecb7db5254'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.346386 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39746d40e51d44819136d84843529680'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.355351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39746d40e51d44819136d84843529680'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.356903 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-5f32c2d6-4a16-4c85-a3be-49a6fd0f4066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c29d658c734d2182cd26ecb7db5254'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.491359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1331/2664] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:22 2022] DELETE /identity/v3/users/39746d40e51d44819136d84843529680 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:23.492520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:23.499050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:23.536986 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:23.576398 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1334/2665] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:22 2022] DELETE /identity/v3/users/23c29d658c734d2182cd26ecb7db5254 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:23.581650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891507d1-f74f-4861-9f34-9d65766c9bdc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:23.581650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891507d1-f74f-4861-9f34-9d65766c9bdc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:23.581650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891507d1-f74f-4861-9f34-9d65766c9bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:23.586114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:23.591295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323d295-7dce-4bf9-a64c-3121b17685e6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:23.600748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-891507d1-f74f-4861-9f34-9d65766c9bdc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:23.603852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-891507d1-f74f-4861-9f34-9d65766c9bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:23.702990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:23.703909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:23.704170 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:23.704488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] PATH_INFO: `/v3/projects/3f976dd7e0df481db1d6d23c58ce83d7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:23.706573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f976dd7e0df481db1d6d23c58ce83d7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:23.709451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:23.722767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1335/2666] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:23.733917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891507d1-f74f-4861-9f34-9d65766c9bdc None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:23.737380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-891507d1-f74f-4861-9f34-9d65766c9bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:23.823794 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891507d1-f74f-4861-9f34-9d65766c9bdc None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:23.828799 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa21ac-4e22-4d60-8a4f-b27c3b0979ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:23.829898 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa21ac-4e22-4d60-8a4f-b27c3b0979ba service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:23.830312 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa21ac-4e22-4d60-8a4f-b27c3b0979ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:23.830681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa21ac-4e22-4d60-8a4f-b27c3b0979ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:23.843175 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa21ac-4e22-4d60-8a4f-b27c3b0979ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:23.844933 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa21ac-4e22-4d60-8a4f-b27c3b0979ba service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:23.857109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1336/2667] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:19:23.884061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f976dd7e0df481db1d6d23c58ce83d7', 'request_id': 'req-0477b0ba-0499-4a8d-b297-db514afac44c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.981292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f976dd7e0df481db1d6d23c58ce83d7', 'request_id': 'req-0477b0ba-0499-4a8d-b297-db514afac44c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:23.989469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f976dd7e0df481db1d6d23c58ce83d7', 'request_id': 'req-0477b0ba-0499-4a8d-b297-db514afac44c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.009816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] The token cache is being invalidate because project 3f976dd7e0df481db1d6d23c58ce83d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:24.010534 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.011627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0477b0ba-0499-4a8d-b297-db514afac44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.013647 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1332/2668] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:23 2022] DELETE /identity/v3/projects/3f976dd7e0df481db1d6d23c58ce83d7 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:24.019440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3ccc-328f-44a2-b3c6-e9f54a62d58b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.024121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3ccc-328f-44a2-b3c6-e9f54a62d58b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.024121 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3ccc-328f-44a2-b3c6-e9f54a62d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.042394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f1bc3ccc-328f-44a2-b3c6-e9f54a62d58b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:24.043745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f1bc3ccc-328f-44a2-b3c6-e9f54a62d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:24.124277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1337/2669] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:24.135043 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3d0e1-df56-4c01-b5b1-5ce9c5d47eb5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.135358 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3d0e1-df56-4c01-b5b1-5ce9c5d47eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.135644 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3d0e1-df56-4c01-b5b1-5ce9c5d47eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.171101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6dc3d0e1-df56-4c01-b5b1-5ce9c5d47eb5 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:24.172360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6dc3d0e1-df56-4c01-b5b1-5ce9c5d47eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:24.186904 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1333/2670] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:24.191913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3ccc-328f-44a2-b3c6-e9f54a62d58b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:24.203080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3ccc-328f-44a2-b3c6-e9f54a62d58b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:24.213064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:24.214291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.214813 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.215426 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.216656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:24.217229 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:24.224453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:24.243197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3d0e1-df56-4c01-b5b1-5ce9c5d47eb5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:24.249796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1338/2671] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:24.254655 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3d0e1-df56-4c01-b5b1-5ce9c5d47eb5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:24.260932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d07c3-acad-46cf-8657-5457068e0477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:24.261888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d07c3-acad-46cf-8657-5457068e0477 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.262265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d07c3-acad-46cf-8657-5457068e0477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.262863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d07c3-acad-46cf-8657-5457068e0477 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.263474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d07c3-acad-46cf-8657-5457068e0477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:24.270895 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d07c3-acad-46cf-8657-5457068e0477 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:24.371224 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:24.373845 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:24.387971 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d173a8-f747-4965-99b7-2fddae6c093e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:24.407926 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:24.409061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.409647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.410010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] PATH_INFO: `/v3/projects/fe4a8c8d793645c8a3b4e20822d2efe4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.411359 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4a8c8d793645c8a3b4e20822d2efe4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:24.413601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:24.469331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1334/2672] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:24 2022] POST /identity/v3/projects => generated 378 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:24.473712 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d07c3-acad-46cf-8657-5457068e0477 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:24.510314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:24.541560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d07c3-acad-46cf-8657-5457068e0477 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:24.550749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:24.550749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.550749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.550749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.551176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:24.551176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:24.594796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:24.603590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4a8c8d793645c8a3b4e20822d2efe4', 'request_id': 'req-9175977c-c470-4636-9e60-e485c6300482'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.714234 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1335/2673] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:24 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:24.715633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:24.716597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4a8c8d793645c8a3b4e20822d2efe4', 'request_id': 'req-9175977c-c470-4636-9e60-e485c6300482'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.717870 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:24.725328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4a8c8d793645c8a3b4e20822d2efe4', 'request_id': 'req-9175977c-c470-4636-9e60-e485c6300482'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.732422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349f08-f050-4af9-8a72-50e0f6308b70 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:24.743316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] The token cache is being invalidate because project fe4a8c8d793645c8a3b4e20822d2efe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:24.743585 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.744261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.746555 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1339/2674] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:24 2022] DELETE /identity/v3/projects/fe4a8c8d793645c8a3b4e20822d2efe4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:24.750669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:24.751842 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:24.802990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:24.803855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.804132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.804835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] PATH_INFO: `/v3/projects/b6cacfb3ffc944f4b091beceefd59923` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.807324 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cacfb3ffc944f4b091beceefd59923)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:24.809426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:24.832254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175977c-c470-4636-9e60-e485c6300482 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:24.838151 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d49e3-eed2-443e-a070-c51ea2110f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:24.839174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d49e3-eed2-443e-a070-c51ea2110f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.839640 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d49e3-eed2-443e-a070-c51ea2110f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.840219 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d49e3-eed2-443e-a070-c51ea2110f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.841071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d49e3-eed2-443e-a070-c51ea2110f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:24.842771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d49e3-eed2-443e-a070-c51ea2110f5f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:24.856024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1340/2675] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:24 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:24.857729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d9b3-f8bf-4f67-9516-33ddb003f78c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.858011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d9b3-f8bf-4f67-9516-33ddb003f78c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.858281 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8d9b3-f8bf-4f67-9516-33ddb003f78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.882301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-77c8d9b3-f8bf-4f67-9516-33ddb003f78c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:24.883901 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-77c8d9b3-f8bf-4f67-9516-33ddb003f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:24.902472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1341/2676] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:24.903323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8d9b3-f8bf-4f67-9516-33ddb003f78c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:24.913985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8d9b3-f8bf-4f67-9516-33ddb003f78c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:24.928007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10840-355e-4b70-891d-a8aa29d217ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:24.928746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10840-355e-4b70-891d-a8aa29d217ec admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.930547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10840-355e-4b70-891d-a8aa29d217ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.930547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10840-355e-4b70-891d-a8aa29d217ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.930547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10840-355e-4b70-891d-a8aa29d217ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:24.932386 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10840-355e-4b70-891d-a8aa29d217ec admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:24.939147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cacfb3ffc944f4b091beceefd59923', 'request_id': 'req-eadc40fb-afe9-447f-8596-3c72dbbc45ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:24.958857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1342/2677] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:24 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:24.960265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d34d4d-8b88-4734-a66e-888d350dce6e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:24.960519 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d34d4d-8b88-4734-a66e-888d350dce6e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:24.960801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d34d4d-8b88-4734-a66e-888d350dce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:24.984822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d7d34d4d-8b88-4734-a66e-888d350dce6e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:24.987953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d7d34d4d-8b88-4734-a66e-888d350dce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:25.027057 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cacfb3ffc944f4b091beceefd59923', 'request_id': 'req-eadc40fb-afe9-447f-8596-3c72dbbc45ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:25.037198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cacfb3ffc944f4b091beceefd59923', 'request_id': 'req-eadc40fb-afe9-447f-8596-3c72dbbc45ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:25.070387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] The token cache is being invalidate because project b6cacfb3ffc944f4b091beceefd59923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:25.071187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:25.072120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:25.074286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1336/2678] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:24 2022] DELETE /identity/v3/projects/b6cacfb3ffc944f4b091beceefd59923 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:25.075154 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.080475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:25.099404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1343/2679] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:25.099404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abca0-eafc-4b1f-87f2-eff8fb779d72 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.099404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abca0-eafc-4b1f-87f2-eff8fb779d72 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.099404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abca0-eafc-4b1f-87f2-eff8fb779d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.114882 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc40fb-afe9-447f-8596-3c72dbbc45ee admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.134163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc4a8-f9c8-4e84-9938-6fe0cc1b706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.135487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-139abca0-eafc-4b1f-87f2-eff8fb779d72 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:25.135633 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc4a8-f9c8-4e84-9938-6fe0cc1b706a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.135887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc4a8-f9c8-4e84-9938-6fe0cc1b706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.136466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc4a8-f9c8-4e84-9938-6fe0cc1b706a admin admin] PATH_INFO: `/v3/projects/4f7b87cdd98141fc844d04730ee40e5e/users/e86e093a274b4a888bd6eb0f348cd0d9/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.137487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-139abca0-eafc-4b1f-87f2-eff8fb779d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:25.148389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1344/2680] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:25.149287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139abca0-eafc-4b1f-87f2-eff8fb779d72 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.161109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139abca0-eafc-4b1f-87f2-eff8fb779d72 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.166392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9e62-bc19-4d24-8c28-c437f804f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.167105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9e62-bc19-4d24-8c28-c437f804f099 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.167395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9e62-bc19-4d24-8c28-c437f804f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.167674 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9e62-bc19-4d24-8c28-c437f804f099 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.168438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9e62-bc19-4d24-8c28-c437f804f099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:25.168746 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9e62-bc19-4d24-8c28-c437f804f099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.170404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9e62-bc19-4d24-8c28-c437f804f099 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.174160 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acc4a8-f9c8-4e84-9938-6fe0cc1b706a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7b87cdd98141fc844d04730ee40e5e, user_id=e86e093a274b4a888bd6eb0f348cd0d9, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.177671 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acc4a8-f9c8-4e84-9938-6fe0cc1b706a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.186091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1345/2681] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:25.187273 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe201e-238d-4162-95a6-0a16182ffd3c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.187560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe201e-238d-4162-95a6-0a16182ffd3c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.187841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe201e-238d-4162-95a6-0a16182ffd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.211174 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1ebe201e-238d-4162-95a6-0a16182ffd3c None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:25.212458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1ebe201e-238d-4162-95a6-0a16182ffd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:25.226792 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1346/2682] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:25.228286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe201e-238d-4162-95a6-0a16182ffd3c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.241420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe201e-238d-4162-95a6-0a16182ffd3c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.246128 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1853b9-b680-4a37-b414-13589fe3f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.246940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1853b9-b680-4a37-b414-13589fe3f566 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.247222 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1853b9-b680-4a37-b414-13589fe3f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.247497 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1853b9-b680-4a37-b414-13589fe3f566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.248295 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1853b9-b680-4a37-b414-13589fe3f566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.250581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1853b9-b680-4a37-b414-13589fe3f566 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.254326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1337/2683] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:25 2022] PUT /identity/v3/projects/4f7b87cdd98141fc844d04730ee40e5e/users/e86e093a274b4a888bd6eb0f348cd0d9/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:25.255654 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc4a8-f9c8-4e84-9938-6fe0cc1b706a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.256215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:25.315164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:25.348133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc4a8-f9c8-4e84-9938-6fe0cc1b706a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.354911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.355094 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1347/2684] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/projects => generated 374 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:25.355201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.355201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.355201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.355514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:25.355896 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.356049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c3509-e674-43ba-899d-078e16e250b8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.356493 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c3509-e674-43ba-899d-078e16e250b8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.356944 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c3509-e674-43ba-899d-078e16e250b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.357670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.375142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1338/2685] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:25.375142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.386710 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6f228-7d09-4e6c-95d3-25c195f159ee admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.405619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2b7c3509-e674-43ba-899d-078e16e250b8 None None] MFA Rules not processed for user `e86e093a274b4a888bd6eb0f348cd0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:25.407034 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2b7c3509-e674-43ba-899d-078e16e250b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:25.464365 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289fdf-44d9-44f7-8f23-cc1c887ee175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.465275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289fdf-44d9-44f7-8f23-cc1c887ee175 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.465571 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289fdf-44d9-44f7-8f23-cc1c887ee175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.465859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289fdf-44d9-44f7-8f23-cc1c887ee175 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.466569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16289fdf-44d9-44f7-8f23-cc1c887ee175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.468643 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16289fdf-44d9-44f7-8f23-cc1c887ee175 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.483268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1348/2686] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:25.484243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c3509-e674-43ba-899d-078e16e250b8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.496351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c3509-e674-43ba-899d-078e16e250b8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.504207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5b71f-5f28-4a03-852d-49e08b046beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.504207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5b71f-5f28-4a03-852d-49e08b046beb admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.504207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5b71f-5f28-4a03-852d-49e08b046beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.504207 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5b71f-5f28-4a03-852d-49e08b046beb admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.504702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5b71f-5f28-4a03-852d-49e08b046beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.505942 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5b71f-5f28-4a03-852d-49e08b046beb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.568972 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1339/2687] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:25.569877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289fdf-44d9-44f7-8f23-cc1c887ee175 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.580355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289fdf-44d9-44f7-8f23-cc1c887ee175 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.588425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b51d-b7ad-4ba5-b7ca-f327779d8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.589897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b51d-b7ad-4ba5-b7ca-f327779d8876 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.590570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b51d-b7ad-4ba5-b7ca-f327779d8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.591395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b51d-b7ad-4ba5-b7ca-f327779d8876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.592989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689b51d-b7ad-4ba5-b7ca-f327779d8876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.600740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689b51d-b7ad-4ba5-b7ca-f327779d8876 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.608868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1349/2688] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/projects => generated 372 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:25.608868 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5b71f-5f28-4a03-852d-49e08b046beb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.682079 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5b71f-5f28-4a03-852d-49e08b046beb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.687647 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511bbc1-e6cd-47a5-ba4d-0bb8370a69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.688356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511bbc1-e6cd-47a5-ba4d-0bb8370a69fc admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.688643 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511bbc1-e6cd-47a5-ba4d-0bb8370a69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.688928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511bbc1-e6cd-47a5-ba4d-0bb8370a69fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.689650 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511bbc1-e6cd-47a5-ba4d-0bb8370a69fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.691322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511bbc1-e6cd-47a5-ba4d-0bb8370a69fc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.699071 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1340/2689] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/projects => generated 378 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:25.702774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1350/2690] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:25 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:25.703727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511bbc1-e6cd-47a5-ba4d-0bb8370a69fc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.705093 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b51d-b7ad-4ba5-b7ca-f327779d8876 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.716710 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511bbc1-e6cd-47a5-ba4d-0bb8370a69fc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.794248 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b51d-b7ad-4ba5-b7ca-f327779d8876 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.799373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770a3b1-0a8d-41f2-b658-2a1ae043c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.801101 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770a3b1-0a8d-41f2-b658-2a1ae043c8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.801456 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770a3b1-0a8d-41f2-b658-2a1ae043c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.801730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770a3b1-0a8d-41f2-b658-2a1ae043c8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.802763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770a3b1-0a8d-41f2-b658-2a1ae043c8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.804114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:25.805052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770a3b1-0a8d-41f2-b658-2a1ae043c8f4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.821749 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f87d4-51a1-40a3-b51c-727ea7519a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.822465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f87d4-51a1-40a3-b51c-727ea7519a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.822751 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f87d4-51a1-40a3-b51c-727ea7519a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.823031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f87d4-51a1-40a3-b51c-727ea7519a36 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.823722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f87d4-51a1-40a3-b51c-727ea7519a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.825704 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f87d4-51a1-40a3-b51c-727ea7519a36 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.890323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1341/2691] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:25.891214 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770a3b1-0a8d-41f2-b658-2a1ae043c8f4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.902679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770a3b1-0a8d-41f2-b658-2a1ae043c8f4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.907459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f386da-5d7b-4827-9ea8-dc6ff820d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.908118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f386da-5d7b-4827-9ea8-dc6ff820d948 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.908425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f386da-5d7b-4827-9ea8-dc6ff820d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.908701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f386da-5d7b-4827-9ea8-dc6ff820d948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.909976 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f386da-5d7b-4827-9ea8-dc6ff820d948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.912336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f386da-5d7b-4827-9ea8-dc6ff820d948 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.920684 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1351/2692] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:25 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:25.932513 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f87d4-51a1-40a3-b51c-727ea7519a36 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.932684 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1342/2693] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:25 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:25.934444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f386da-5d7b-4827-9ea8-dc6ff820d948 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.934882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f87d4-51a1-40a3-b51c-727ea7519a36 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.940793 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95093-66e9-4edd-999c-01fae6e2602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.941695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95093-66e9-4edd-999c-01fae6e2602f admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.947382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95093-66e9-4edd-999c-01fae6e2602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.947382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95093-66e9-4edd-999c-01fae6e2602f admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.947382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b95093-66e9-4edd-999c-01fae6e2602f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.947382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b95093-66e9-4edd-999c-01fae6e2602f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.957757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f386da-5d7b-4827-9ea8-dc6ff820d948 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.959437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1352/2694] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:25 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:25.960411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95093-66e9-4edd-999c-01fae6e2602f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.964981 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412075a-aadf-40e5-9f2e-0d98f9870bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.966142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412075a-aadf-40e5-9f2e-0d98f9870bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.966679 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412075a-aadf-40e5-9f2e-0d98f9870bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.967217 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412075a-aadf-40e5-9f2e-0d98f9870bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.968231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412075a-aadf-40e5-9f2e-0d98f9870bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:25.971072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412075a-aadf-40e5-9f2e-0d98f9870bc8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:25.973665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:25.975010 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95093-66e9-4edd-999c-01fae6e2602f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:25.980018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba389a1-ad43-41da-83f0-ef83fab24ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:25.981062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba389a1-ad43-41da-83f0-ef83fab24ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:25.981372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba389a1-ad43-41da-83f0-ef83fab24ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:25.981737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba389a1-ad43-41da-83f0-ef83fab24ea6 admin admin] PATH_INFO: `/v3/projects/2fbdeaaacca54657aa5fbd70e052f3cc/users/1faa84599b8f436886adb7f0c06dc6d8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:25.988840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1343/2695] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:25 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:25.988840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412075a-aadf-40e5-9f2e-0d98f9870bc8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:25.998861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412075a-aadf-40e5-9f2e-0d98f9870bc8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:26.004832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b33c4-32ae-492b-82be-e3fd9727233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:26.005663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b33c4-32ae-492b-82be-e3fd9727233c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.005948 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b33c4-32ae-492b-82be-e3fd9727233c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.006376 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b33c4-32ae-492b-82be-e3fd9727233c admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.007183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b33c4-32ae-492b-82be-e3fd9727233c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.007409 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba389a1-ad43-41da-83f0-ef83fab24ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbdeaaacca54657aa5fbd70e052f3cc, user_id=1faa84599b8f436886adb7f0c06dc6d8, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.009325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b33c4-32ae-492b-82be-e3fd9727233c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:26.011330 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba389a1-ad43-41da-83f0-ef83fab24ea6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:26.022980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1344/2696] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:25 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:26.023887 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b33c4-32ae-492b-82be-e3fd9727233c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:26.035339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b33c4-32ae-492b-82be-e3fd9727233c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:26.041187 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcf7e3-aa53-4684-8ca9-b6f741d19934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:26.041857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcf7e3-aa53-4684-8ca9-b6f741d19934 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.042144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcf7e3-aa53-4684-8ca9-b6f741d19934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.042416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcf7e3-aa53-4684-8ca9-b6f741d19934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.043146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcf7e3-aa53-4684-8ca9-b6f741d19934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.044798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcf7e3-aa53-4684-8ca9-b6f741d19934 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:26.060414 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1345/2697] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:26 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:26.061907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcf7e3-aa53-4684-8ca9-b6f741d19934 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:26.072901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcf7e3-aa53-4684-8ca9-b6f741d19934 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:26.077936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc3fb-7904-47a8-8881-8bba98045226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:26.080040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc3fb-7904-47a8-8881-8bba98045226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.080040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc3fb-7904-47a8-8881-8bba98045226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.080040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc3fb-7904-47a8-8881-8bba98045226 admin admin] PATH_INFO: `/v3/projects/a60f5c3ebd3244aeba264dfeed4a6b7b/users/d7a7e585c21745bc998d3d1c3d522442/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.095949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc3fb-7904-47a8-8881-8bba98045226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60f5c3ebd3244aeba264dfeed4a6b7b, user_id=d7a7e585c21745bc998d3d1c3d522442, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.099316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc3fb-7904-47a8-8881-8bba98045226 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:26.125011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1353/2698] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:25 2022] PUT /identity/v3/projects/2fbdeaaacca54657aa5fbd70e052f3cc/users/1faa84599b8f436886adb7f0c06dc6d8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:26.125924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba389a1-ad43-41da-83f0-ef83fab24ea6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:26.170932 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1346/2699] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:26 2022] PUT /identity/v3/projects/a60f5c3ebd3244aeba264dfeed4a6b7b/users/d7a7e585c21745bc998d3d1c3d522442/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:26.172996 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7cca5-c689-48d8-8cad-e136714df5fb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.173470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7cca5-c689-48d8-8cad-e136714df5fb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.174260 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7cca5-c689-48d8-8cad-e136714df5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.226160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba389a1-ad43-41da-83f0-ef83fab24ea6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:26.256355 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c9c7cca5-c689-48d8-8cad-e136714df5fb None None] MFA Rules not processed for user `1faa84599b8f436886adb7f0c06dc6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:26.257925 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c9c7cca5-c689-48d8-8cad-e136714df5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:26.306125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:26.307116 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.308190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.308190 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] PATH_INFO: `/v3/projects/f5acb0bcbf7947e1a3ee7453ef3be793/users/e023551b159d45fda69f00d9ff9fbd30/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.327255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5acb0bcbf7947e1a3ee7453ef3be793, user_id=e023551b159d45fda69f00d9ff9fbd30, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.332197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:26.395660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1347/2700] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:26.397300 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdda9ca-1cc6-4136-941d-a588f074a16f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.397574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdda9ca-1cc6-4136-941d-a588f074a16f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.397854 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdda9ca-1cc6-4136-941d-a588f074a16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.430917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5bdda9ca-1cc6-4136-941d-a588f074a16f None None] MFA Rules not processed for user `d7a7e585c21745bc998d3d1c3d522442`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:26.432253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5bdda9ca-1cc6-4136-941d-a588f074a16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:26.460099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1354/2701] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:26 2022] PUT /identity/v3/projects/f5acb0bcbf7947e1a3ee7453ef3be793/users/e023551b159d45fda69f00d9ff9fbd30/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:26.464507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:26.466574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:26.514709 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1348/2702] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:26.518443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d36a1-1ebf-4fb7-98bc-3a811a5a918d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.518443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d36a1-1ebf-4fb7-98bc-3a811a5a918d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.518443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d36a1-1ebf-4fb7-98bc-3a811a5a918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.519242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:26.538294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-516d36a1-1ebf-4fb7-98bc-3a811a5a918d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:26.540550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-516d36a1-1ebf-4fb7-98bc-3a811a5a918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:26.555115 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e826c-5c30-4ce3-b8b9-c8328ec36f1e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:26.558949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a2c87f8db748ba9264b141f059aab9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:26.559613 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.559891 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.560333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.574780 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:26.627504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1349/2703] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:26.629594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d36a1-1ebf-4fb7-98bc-3a811a5a918d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:26.642580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d36a1-1ebf-4fb7-98bc-3a811a5a918d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:26.649416 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc2696-73bb-4a8e-84d5-48dfaa9267f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:26.650033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc2696-73bb-4a8e-84d5-48dfaa9267f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.650315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc2696-73bb-4a8e-84d5-48dfaa9267f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.650590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc2696-73bb-4a8e-84d5-48dfaa9267f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.651278 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc2696-73bb-4a8e-84d5-48dfaa9267f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.653522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc2696-73bb-4a8e-84d5-48dfaa9267f7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:26.674254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.675810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:26.686090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1355/2704] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:26.687165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:26.688636 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:26.774668 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2becad5-a2f7-45f9-b7d6-b477aefbce6a service glance] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:26.787198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a797-4687-4c09-833d-d661da169f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:26.787660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1350/2705] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:26 2022] POST /identity/v3/projects => generated 380 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:26.788356 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a797-4687-4c09-833d-d661da169f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.788756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc2696-73bb-4a8e-84d5-48dfaa9267f7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:26.794508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a797-4687-4c09-833d-d661da169f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.794508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0a797-4687-4c09-833d-d661da169f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.807869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0a797-4687-4c09-833d-d661da169f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.810062 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0a797-4687-4c09-833d-d661da169f27 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:26.834557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1356/2706] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:26.888565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc2696-73bb-4a8e-84d5-48dfaa9267f7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:26.895132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287e25-5380-43cc-8b8b-82292a797571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:26.895871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287e25-5380-43cc-8b8b-82292a797571 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:26.896163 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287e25-5380-43cc-8b8b-82292a797571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:26.896474 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287e25-5380-43cc-8b8b-82292a797571 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:26.897306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287e25-5380-43cc-8b8b-82292a797571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:26.899664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287e25-5380-43cc-8b8b-82292a797571 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:27.056584 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1351/2707] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:26 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:27.061255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a797-4687-4c09-833d-d661da169f27 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:27.079456 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0a797-4687-4c09-833d-d661da169f27 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:27.086923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc50fb3-ed4d-4068-83a5-be64dc06961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:27.088195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc50fb3-ed4d-4068-83a5-be64dc06961c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.088557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc50fb3-ed4d-4068-83a5-be64dc06961c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.088814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc50fb3-ed4d-4068-83a5-be64dc06961c admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.089554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc50fb3-ed4d-4068-83a5-be64dc06961c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:27.092328 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc50fb3-ed4d-4068-83a5-be64dc06961c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:27.108165 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1357/2708] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:27 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:27.112088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287e25-5380-43cc-8b8b-82292a797571 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:27.123813 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287e25-5380-43cc-8b8b-82292a797571 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:27.129141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66599f4-4aed-43b0-afea-2f8f2bf587eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:27.130180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66599f4-4aed-43b0-afea-2f8f2bf587eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.130523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66599f4-4aed-43b0-afea-2f8f2bf587eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.130916 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66599f4-4aed-43b0-afea-2f8f2bf587eb admin admin] PATH_INFO: `/v3/projects/a75364be32224a0ab4d76b9e1b04dcd1/users/8baca59a8165407f8a121c435a55acd4/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.148213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66599f4-4aed-43b0-afea-2f8f2bf587eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75364be32224a0ab4d76b9e1b04dcd1, user_id=8baca59a8165407f8a121c435a55acd4, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:27.151048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66599f4-4aed-43b0-afea-2f8f2bf587eb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:27.343067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1352/2709] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:27 2022] PUT /identity/v3/projects/a75364be32224a0ab4d76b9e1b04dcd1/users/8baca59a8165407f8a121c435a55acd4/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:27.347454 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc50fb3-ed4d-4068-83a5-be64dc06961c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:27.366265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc50fb3-ed4d-4068-83a5-be64dc06961c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:27.546373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a653fa-b18a-49b6-82e1-f5d8a7d55e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:27.546373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a653fa-b18a-49b6-82e1-f5d8a7d55e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.546373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a653fa-b18a-49b6-82e1-f5d8a7d55e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.546373 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a653fa-b18a-49b6-82e1-f5d8a7d55e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.547796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a653fa-b18a-49b6-82e1-f5d8a7d55e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:27.547796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a653fa-b18a-49b6-82e1-f5d8a7d55e3b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:27.547796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1358/2710] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:27 2022] GET /identity/v3/roles => generated 1427 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:27.553061 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66599f4-4aed-43b0-afea-2f8f2bf587eb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:27.566049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66599f4-4aed-43b0-afea-2f8f2bf587eb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:27.574872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:27.577272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.579426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.580133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] PATH_INFO: `/v3/projects/a75364be32224a0ab4d76b9e1b04dcd1/users/8baca59a8165407f8a121c435a55acd4/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.586497 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75364be32224a0ab4d76b9e1b04dcd1, user_id=8baca59a8165407f8a121c435a55acd4, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:27.616472 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:27.636198 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1353/2711] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:27 2022] PUT /identity/v3/projects/a75364be32224a0ab4d76b9e1b04dcd1/users/8baca59a8165407f8a121c435a55acd4/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:27.647461 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca4c0-96f4-4143-88b0-0f65213928b7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.647747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca4c0-96f4-4143-88b0-0f65213928b7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.648029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca4c0-96f4-4143-88b0-0f65213928b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.700577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2bfca4c0-96f4-4143-88b0-0f65213928b7 None None] MFA Rules not processed for user `8baca59a8165407f8a121c435a55acd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:27.704614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2bfca4c0-96f4-4143-88b0-0f65213928b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:27.712211 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:27.801214 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1359/2712] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:27.811195 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:27.813169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:27.908425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a0c3-1f22-4f3e-a629-b0bf9fc1199c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:27.912917 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad9b2a-9ba6-42ab-aa11-361fd15fce53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:27.913607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad9b2a-9ba6-42ab-aa11-361fd15fce53 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.913989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad9b2a-9ba6-42ab-aa11-361fd15fce53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.914336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad9b2a-9ba6-42ab-aa11-361fd15fce53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.933436 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad9b2a-9ba6-42ab-aa11-361fd15fce53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:27.935499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad9b2a-9ba6-42ab-aa11-361fd15fce53 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:27.951265 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1354/2713] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:28.310209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfca4c0-96f4-4143-88b0-0f65213928b7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:28.321768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfca4c0-96f4-4143-88b0-0f65213928b7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:28.325487 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3475b10-de17-46d4-b962-86d56d063075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:28.331943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3475b10-de17-46d4-b962-86d56d063075 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:28.331943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3475b10-de17-46d4-b962-86d56d063075 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:28.331943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3475b10-de17-46d4-b962-86d56d063075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:28.409030 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3475b10-de17-46d4-b962-86d56d063075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:28.410894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3475b10-de17-46d4-b962-86d56d063075 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:28.434371 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1360/2714] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:29.215157 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2fac3-1b41-4f15-94ab-9baa7878e176 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:29.215665 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2fac3-1b41-4f15-94ab-9baa7878e176 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:29.215772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2fac3-1b41-4f15-94ab-9baa7878e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:29.222545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:29.260403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8ba2fac3-1b41-4f15-94ab-9baa7878e176 None None] MFA Rules not processed for user `e023551b159d45fda69f00d9ff9fbd30`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:29.261757 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8ba2fac3-1b41-4f15-94ab-9baa7878e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:29.372968 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1355/2715] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:29.377327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3475b10-de17-46d4-b962-86d56d063075 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:29.458270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3475b10-de17-46d4-b962-86d56d063075 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:29.468285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cddc3-d660-4045-8df1-025071ae06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:29.469035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cddc3-d660-4045-8df1-025071ae06b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:29.469316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cddc3-d660-4045-8df1-025071ae06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:29.469591 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cddc3-d660-4045-8df1-025071ae06b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:29.470303 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cddc3-d660-4045-8df1-025071ae06b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:29.473053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cddc3-d660-4045-8df1-025071ae06b7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:29.635788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1361/2716] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:29 2022] POST /identity/v3/projects => generated 374 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:19:29.642228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2fac3-1b41-4f15-94ab-9baa7878e176 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:29.654072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2fac3-1b41-4f15-94ab-9baa7878e176 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:29.728500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f1636-a47d-409e-bb00-3cc6010b7e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:29.729331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1636-a47d-409e-bb00-3cc6010b7e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:29.729848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1636-a47d-409e-bb00-3cc6010b7e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:29.730364 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f1636-a47d-409e-bb00-3cc6010b7e2c admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:29.731306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f1636-a47d-409e-bb00-3cc6010b7e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:29.733393 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f1636-a47d-409e-bb00-3cc6010b7e2c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:29.873259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1356/2717] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:29 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:29.878836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cddc3-d660-4045-8df1-025071ae06b7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:29.889739 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cddc3-d660-4045-8df1-025071ae06b7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:29.895293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf17b6-87fd-4102-8702-4bfef84a82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:29.896083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf17b6-87fd-4102-8702-4bfef84a82c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:29.896436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf17b6-87fd-4102-8702-4bfef84a82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:29.901360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf17b6-87fd-4102-8702-4bfef84a82c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:29.901360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf17b6-87fd-4102-8702-4bfef84a82c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:29.901360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf17b6-87fd-4102-8702-4bfef84a82c4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:29.915906 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1362/2718] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:29 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:29.917133 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f1636-a47d-409e-bb00-3cc6010b7e2c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:29.928622 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f1636-a47d-409e-bb00-3cc6010b7e2c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:29.941842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faac447-3e64-4c89-8210-838657051dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:29.942994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faac447-3e64-4c89-8210-838657051dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:29.943293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faac447-3e64-4c89-8210-838657051dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:29.943582 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faac447-3e64-4c89-8210-838657051dfb admin admin] PATH_INFO: `/v3/projects/0dccf75d48834b5686eddbca272e5429/users/b100f1366803463991dd1f5a8c81f5e1/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:29.961625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faac447-3e64-4c89-8210-838657051dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dccf75d48834b5686eddbca272e5429, user_id=b100f1366803463991dd1f5a8c81f5e1, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:29.964719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faac447-3e64-4c89-8210-838657051dfb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:30.080118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1357/2719] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:29 2022] PUT /identity/v3/projects/0dccf75d48834b5686eddbca272e5429/users/b100f1366803463991dd1f5a8c81f5e1/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:30.084875 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf17b6-87fd-4102-8702-4bfef84a82c4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:30.096099 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf17b6-87fd-4102-8702-4bfef84a82c4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:30.108897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:30.155673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dadac2-82cc-4ccd-a590-1bffcb0aae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:30.156401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dadac2-82cc-4ccd-a590-1bffcb0aae47 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:30.156682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dadac2-82cc-4ccd-a590-1bffcb0aae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:30.157275 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dadac2-82cc-4ccd-a590-1bffcb0aae47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:30.157663 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dadac2-82cc-4ccd-a590-1bffcb0aae47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:30.159268 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dadac2-82cc-4ccd-a590-1bffcb0aae47 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:30.169934 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1363/2720] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:30 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:30.174286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faac447-3e64-4c89-8210-838657051dfb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:30.186284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faac447-3e64-4c89-8210-838657051dfb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:30.192143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdb6ab-10a0-4c59-a087-052da497b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:30.193092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb6ab-10a0-4c59-a087-052da497b789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:30.193368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb6ab-10a0-4c59-a087-052da497b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:30.193690 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdb6ab-10a0-4c59-a087-052da497b789 admin admin] PATH_INFO: `/v3/projects/0dccf75d48834b5686eddbca272e5429/users/b100f1366803463991dd1f5a8c81f5e1/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:30.195664 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdb6ab-10a0-4c59-a087-052da497b789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dccf75d48834b5686eddbca272e5429, user_id=b100f1366803463991dd1f5a8c81f5e1, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:30.198625 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdb6ab-10a0-4c59-a087-052da497b789 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:30.210574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1358/2721] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:30 2022] PUT /identity/v3/projects/0dccf75d48834b5686eddbca272e5429/users/b100f1366803463991dd1f5a8c81f5e1/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:31.824008 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246865-0fda-4f2a-a3f3-0448d29c609c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:31.828980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246865-0fda-4f2a-a3f3-0448d29c609c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:31.828980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246865-0fda-4f2a-a3f3-0448d29c609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:31.863978 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-03246865-0fda-4f2a-a3f3-0448d29c609c None None] MFA Rules not processed for user `b100f1366803463991dd1f5a8c81f5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:31.865262 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-03246865-0fda-4f2a-a3f3-0448d29c609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:31.945314 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1364/2722] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:31.959256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28177-d9bf-48b5-98ef-9a294fab8537 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:31.959840 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28177-d9bf-48b5-98ef-9a294fab8537 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:31.960132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28177-d9bf-48b5-98ef-9a294fab8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:31.989453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-dda28177-d9bf-48b5-98ef-9a294fab8537 None None] MFA Rules not processed for user `e023551b159d45fda69f00d9ff9fbd30`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:31.989453 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dda28177-d9bf-48b5-98ef-9a294fab8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:32.025613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:32.037399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1359/2723] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:32.048661 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03246865-0fda-4f2a-a3f3-0448d29c609c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:32.050675 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-03246865-0fda-4f2a-a3f3-0448d29c609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:32.140601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03246865-0fda-4f2a-a3f3-0448d29c609c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:32.147141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635868c-8067-4407-bfc2-e8e0ddd4d607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:32.147788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635868c-8067-4407-bfc2-e8e0ddd4d607 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:32.148110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635868c-8067-4407-bfc2-e8e0ddd4d607 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:32.148445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635868c-8067-4407-bfc2-e8e0ddd4d607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:32.157348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635868c-8067-4407-bfc2-e8e0ddd4d607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:32.158977 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635868c-8067-4407-bfc2-e8e0ddd4d607 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:32.170117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1365/2724] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:32.422215 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28177-d9bf-48b5-98ef-9a294fab8537 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:32.492787 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28177-d9bf-48b5-98ef-9a294fab8537 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:32.496264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f56eb-a5d0-41d0-914b-4980dfc85dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:32.496931 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f56eb-a5d0-41d0-914b-4980dfc85dad service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:32.497211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f56eb-a5d0-41d0-914b-4980dfc85dad service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:32.497482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f56eb-a5d0-41d0-914b-4980dfc85dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:32.499347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3b3f56eb-a5d0-41d0-914b-4980dfc85dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:32.509417 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f56eb-a5d0-41d0-914b-4980dfc85dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:32.510850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f56eb-a5d0-41d0-914b-4980dfc85dad service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:32.519969 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1360/2725] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:33.836474 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635868c-8067-4407-bfc2-e8e0ddd4d607 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:33.863962 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:33.903508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635868c-8067-4407-bfc2-e8e0ddd4d607 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:33.908082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:33.908987 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:33.912997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:33.912997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] PATH_INFO: `/v3/users/e86e093a274b4a888bd6eb0f348cd0d9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:33.912997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86e093a274b4a888bd6eb0f348cd0d9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:33.914440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:34.160727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86e093a274b4a888bd6eb0f348cd0d9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:34.161376 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86e093a274b4a888bd6eb0f348cd0d9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:34.161969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86e093a274b4a888bd6eb0f348cd0d9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:34.176232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86e093a274b4a888bd6eb0f348cd0d9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:34.183326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86e093a274b4a888bd6eb0f348cd0d9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:34.289196 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1366/2726] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:33 2022] DELETE /identity/v3/users/e86e093a274b4a888bd6eb0f348cd0d9 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:34.294325 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d382-5edf-4ba6-bdb8-1cc8eb14fc6d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:34.294856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d382-5edf-4ba6-bdb8-1cc8eb14fc6d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:34.294856 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571d382-5edf-4ba6-bdb8-1cc8eb14fc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:34.313306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1571d382-5edf-4ba6-bdb8-1cc8eb14fc6d None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:34.314517 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1571d382-5edf-4ba6-bdb8-1cc8eb14fc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:34.377976 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1361/2727] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:34.388732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:34.390179 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:34.457974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb2438-136f-4996-bd55-76ae7dff7a3b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:34.462332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c033-7f9c-4113-97c9-391af891a46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:34.462981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c033-7f9c-4113-97c9-391af891a46f service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:34.463258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c033-7f9c-4113-97c9-391af891a46f service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:34.463527 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c033-7f9c-4113-97c9-391af891a46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:34.473910 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c033-7f9c-4113-97c9-391af891a46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:34.475492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c033-7f9c-4113-97c9-391af891a46f service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:34.486915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1367/2728] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:35.064793 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d382-5edf-4ba6-bdb8-1cc8eb14fc6d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:35.066320 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1571d382-5edf-4ba6-bdb8-1cc8eb14fc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:35.085199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571d382-5edf-4ba6-bdb8-1cc8eb14fc6d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:35.089859 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:35.092708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:35.092708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:35.092708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] PATH_INFO: `/v3/projects/4f7b87cdd98141fc844d04730ee40e5e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:35.092708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7b87cdd98141fc844d04730ee40e5e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:35.094415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:35.273463 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7b87cdd98141fc844d04730ee40e5e', 'request_id': 'req-80eb8329-6035-477a-9601-0cce2e6b53dc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.414292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7b87cdd98141fc844d04730ee40e5e', 'request_id': 'req-80eb8329-6035-477a-9601-0cce2e6b53dc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.421794 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7b87cdd98141fc844d04730ee40e5e', 'request_id': 'req-80eb8329-6035-477a-9601-0cce2e6b53dc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.434759 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] The token cache is being invalidate because project 4f7b87cdd98141fc844d04730ee40e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:35.435189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.435946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.437848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1362/2729] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:35 2022] DELETE /identity/v3/projects/4f7b87cdd98141fc844d04730ee40e5e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:35.441869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c033-7f9c-4113-97c9-391af891a46f service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:35.454506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c033-7f9c-4113-97c9-391af891a46f service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:35.498895 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:35.514748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:35.515761 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:35.516071 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:35.516394 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] PATH_INFO: `/v3/users/d7a7e585c21745bc998d3d1c3d522442` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:35.518403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a7e585c21745bc998d3d1c3d522442)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:35.520918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:35.788317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a7e585c21745bc998d3d1c3d522442'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.789064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a7e585c21745bc998d3d1c3d522442'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.789653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a7e585c21745bc998d3d1c3d522442'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.804208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a7e585c21745bc998d3d1c3d522442'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.811142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a7e585c21745bc998d3d1c3d522442'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:35.932384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1368/2730] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:35 2022] DELETE /identity/v3/users/d7a7e585c21745bc998d3d1c3d522442 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:36.824468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:36.824468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:36.834431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb8329-6035-477a-9601-0cce2e6b53dc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:36.849876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:36.912054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:36.913110 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:36.913491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:36.913869 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] PATH_INFO: `/v3/projects/a60f5c3ebd3244aeba264dfeed4a6b7b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:36.915262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a60f5c3ebd3244aeba264dfeed4a6b7b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:36.917347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:37.071627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a60f5c3ebd3244aeba264dfeed4a6b7b', 'request_id': 'req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.227741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a60f5c3ebd3244aeba264dfeed4a6b7b', 'request_id': 'req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.235568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a60f5c3ebd3244aeba264dfeed4a6b7b', 'request_id': 'req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.250359 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] The token cache is being invalidate because project a60f5c3ebd3244aeba264dfeed4a6b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:37.250692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.251347 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.253306 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1363/2731] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:36 2022] DELETE /identity/v3/projects/a60f5c3ebd3244aeba264dfeed4a6b7b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:37.257538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:37.258997 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:37.272915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873f9c4-d584-44e1-b908-6b7ee7ba8b1f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:37.359806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:37.360823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:37.361192 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:37.361533 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] PATH_INFO: `/v3/users/8baca59a8165407f8a121c435a55acd4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:37.365404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8baca59a8165407f8a121c435a55acd4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:37.377560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:37.641754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baca59a8165407f8a121c435a55acd4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.642395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baca59a8165407f8a121c435a55acd4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.643007 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baca59a8165407f8a121c435a55acd4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.655688 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baca59a8165407f8a121c435a55acd4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.656903 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:37.664395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c8ab7c39-951f-40fd-9075-88406ba69fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baca59a8165407f8a121c435a55acd4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:37.757660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1369/2732] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:37 2022] DELETE /identity/v3/users/8baca59a8165407f8a121c435a55acd4 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:38.325186 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:38.328287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:38.359164 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e29a5-c6d7-4cd5-8c9f-4169507d7422 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:38.421605 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:38.422477 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:38.422756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:38.423031 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] PATH_INFO: `/v3/projects/a75364be32224a0ab4d76b9e1b04dcd1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:38.427104 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75364be32224a0ab4d76b9e1b04dcd1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:38.430755 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:38.563141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:38.565587 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75364be32224a0ab4d76b9e1b04dcd1', 'request_id': 'req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:38.716816 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75364be32224a0ab4d76b9e1b04dcd1', 'request_id': 'req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:38.725340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75364be32224a0ab4d76b9e1b04dcd1', 'request_id': 'req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:38.739292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] The token cache is being invalidate because project a75364be32224a0ab4d76b9e1b04dcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:38.739292 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:38.740507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d5debb3d-5542-45f2-ac3b-c3ecfa956be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:38.742302 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1364/2733] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:38 2022] DELETE /identity/v3/projects/a75364be32224a0ab4d76b9e1b04dcd1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:38.753401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be497d76-9736-4b33-86bb-e591d007df50 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:38.753401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be497d76-9736-4b33-86bb-e591d007df50 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:38.753401 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be497d76-9736-4b33-86bb-e591d007df50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:38.773217 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-be497d76-9736-4b33-86bb-e591d007df50 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:38.775470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-be497d76-9736-4b33-86bb-e591d007df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:38.851415 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1370/2734] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:38.861209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ecc4c-75cd-4cf4-b79b-b5322efeac84 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:38.861499 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ecc4c-75cd-4cf4-b79b-b5322efeac84 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:38.862201 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ecc4c-75cd-4cf4-b79b-b5322efeac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:38.883159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-154ecc4c-75cd-4cf4-b79b-b5322efeac84 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:38.884403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-154ecc4c-75cd-4cf4-b79b-b5322efeac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:38.892660 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1365/2735] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:38.897412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be497d76-9736-4b33-86bb-e591d007df50 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:38.907284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be497d76-9736-4b33-86bb-e591d007df50 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:38.912635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:38.913291 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:38.913575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:38.913852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:38.914572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:38.914880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:38.916517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:38.929266 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1371/2736] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:38.933927 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ecc4c-75cd-4cf4-b79b-b5322efeac84 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:38.944753 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ecc4c-75cd-4cf4-b79b-b5322efeac84 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:38.949390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198bdd-54b0-40d3-9451-ff2307fa7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:38.950074 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198bdd-54b0-40d3-9451-ff2307fa7190 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:38.950350 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198bdd-54b0-40d3-9451-ff2307fa7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:38.950618 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198bdd-54b0-40d3-9451-ff2307fa7190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:38.951301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7198bdd-54b0-40d3-9451-ff2307fa7190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:38.953255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7198bdd-54b0-40d3-9451-ff2307fa7190 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:39.067682 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1366/2737] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:38 2022] POST /identity/v3/projects => generated 386 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:39.069245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:39.080748 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad072c5-59b8-4ebe-b93e-f570195a2089 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:39.145329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe02c7-7797-4ee6-8f9d-c954711b5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:39.146157 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe02c7-7797-4ee6-8f9d-c954711b5602 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:39.146491 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe02c7-7797-4ee6-8f9d-c954711b5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:39.146770 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe02c7-7797-4ee6-8f9d-c954711b5602 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:39.147604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe02c7-7797-4ee6-8f9d-c954711b5602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:39.149554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe02c7-7797-4ee6-8f9d-c954711b5602 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:39.243682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1372/2738] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:39 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:39.247831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198bdd-54b0-40d3-9451-ff2307fa7190 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:39.258247 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198bdd-54b0-40d3-9451-ff2307fa7190 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:39.262937 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc15314-d065-40a3-b237-bb48b086af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:39.263594 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15314-d065-40a3-b237-bb48b086af83 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:39.263876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15314-d065-40a3-b237-bb48b086af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:39.264151 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15314-d065-40a3-b237-bb48b086af83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:39.264923 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc15314-d065-40a3-b237-bb48b086af83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:39.266581 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc15314-d065-40a3-b237-bb48b086af83 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:39.278663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1367/2739] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:39 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:39.282753 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe02c7-7797-4ee6-8f9d-c954711b5602 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:39.294884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe02c7-7797-4ee6-8f9d-c954711b5602 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:39.300883 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254f009-9b35-4499-acc5-0097a1dcd35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:39.305937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f009-9b35-4499-acc5-0097a1dcd35b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:39.305937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f009-9b35-4499-acc5-0097a1dcd35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:39.305937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f009-9b35-4499-acc5-0097a1dcd35b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:39.305937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254f009-9b35-4499-acc5-0097a1dcd35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:39.305937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254f009-9b35-4499-acc5-0097a1dcd35b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:39.316717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1373/2740] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:39 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:19:39.320928 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc15314-d065-40a3-b237-bb48b086af83 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:39.332213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc15314-d065-40a3-b237-bb48b086af83 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:39.337438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:39.338461 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:39.338716 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:39.338992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] PATH_INFO: `/v3/projects/190f4fc6b1c84a498b455540624a457e/users/d3ea5ae0fcce42229754d5b0d001fae2/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:39.355137 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190f4fc6b1c84a498b455540624a457e, user_id=d3ea5ae0fcce42229754d5b0d001fae2, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:39.357864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:39.583321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1368/2741] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:39 2022] PUT /identity/v3/projects/190f4fc6b1c84a498b455540624a457e/users/d3ea5ae0fcce42229754d5b0d001fae2/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:39.594545 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec45f-7d09-425c-be83-85bbaf82db3d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:39.594882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec45f-7d09-425c-be83-85bbaf82db3d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:39.595163 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec45f-7d09-425c-be83-85bbaf82db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:39.622453 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dbfec45f-7d09-425c-be83-85bbaf82db3d None None] MFA Rules not processed for user `d3ea5ae0fcce42229754d5b0d001fae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:39.623968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dbfec45f-7d09-425c-be83-85bbaf82db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:39.667114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:39.706208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1374/2742] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:39.719309 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:39.721530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:39.804421 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fd8aa-31f8-4bd6-b93c-9a57330e7da0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:39.808055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0399d-47d6-482b-bda3-03dcd4541ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:39.808730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0399d-47d6-482b-bda3-03dcd4541ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:39.809011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0399d-47d6-482b-bda3-03dcd4541ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:39.809285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0399d-47d6-482b-bda3-03dcd4541ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:39.823992 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0399d-47d6-482b-bda3-03dcd4541ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:39.825538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0399d-47d6-482b-bda3-03dcd4541ee0 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:39.838694 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1369/2743] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:44.857405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfec45f-7d09-425c-be83-85bbaf82db3d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:44.858835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dbfec45f-7d09-425c-be83-85bbaf82db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:44.923676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfec45f-7d09-425c-be83-85bbaf82db3d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:44.929220 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:44.930208 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:44.930410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:44.930681 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] PATH_INFO: `/v3/users/1faa84599b8f436886adb7f0c06dc6d8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:44.931936 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1faa84599b8f436886adb7f0c06dc6d8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:44.933913 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:45.277187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1faa84599b8f436886adb7f0c06dc6d8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:45.277947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1faa84599b8f436886adb7f0c06dc6d8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:45.278754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1faa84599b8f436886adb7f0c06dc6d8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:45.308347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1faa84599b8f436886adb7f0c06dc6d8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:45.316352 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1faa84599b8f436886adb7f0c06dc6d8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:45.429449 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1375/2744] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:44 2022] DELETE /identity/v3/users/1faa84599b8f436886adb7f0c06dc6d8 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:45.435637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be091b-e55b-4f9c-a5fc-95c1a22be8a7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:45.437091 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be091b-e55b-4f9c-a5fc-95c1a22be8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:45.438060 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be091b-e55b-4f9c-a5fc-95c1a22be8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:45.459964 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f9be091b-e55b-4f9c-a5fc-95c1a22be8a7 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:45.461483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f9be091b-e55b-4f9c-a5fc-95c1a22be8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:45.531858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1370/2745] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:45.542238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:45.543692 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:45.605603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dcc11-f6d1-4ac7-b357-c86556a3f8cb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:45.609603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f3d73-4a61-4e3f-9eab-202ba09d8c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:45.610267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3d73-4a61-4e3f-9eab-202ba09d8c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:45.610550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3d73-4a61-4e3f-9eab-202ba09d8c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:45.610830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f3d73-4a61-4e3f-9eab-202ba09d8c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:45.621439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f3d73-4a61-4e3f-9eab-202ba09d8c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:45.622869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f3d73-4a61-4e3f-9eab-202ba09d8c15 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:45.628364 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:45.633907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1376/2746] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:46.161310 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be091b-e55b-4f9c-a5fc-95c1a22be8a7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:46.162848 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f9be091b-e55b-4f9c-a5fc-95c1a22be8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:46.174756 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be091b-e55b-4f9c-a5fc-95c1a22be8a7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:46.180810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:46.181681 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:46.182008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:46.182237 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] PATH_INFO: `/v3/projects/2fbdeaaacca54657aa5fbd70e052f3cc` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:46.183428 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbdeaaacca54657aa5fbd70e052f3cc)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:46.185422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:46.199044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:46.313802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbdeaaacca54657aa5fbd70e052f3cc', 'request_id': 'req-5ab33690-24c5-44c9-9bde-eecaf511606e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:46.420213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbdeaaacca54657aa5fbd70e052f3cc', 'request_id': 'req-5ab33690-24c5-44c9-9bde-eecaf511606e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:46.427379 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbdeaaacca54657aa5fbd70e052f3cc', 'request_id': 'req-5ab33690-24c5-44c9-9bde-eecaf511606e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:46.438686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] The token cache is being invalidate because project 2fbdeaaacca54657aa5fbd70e052f3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:46.439363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:46.439691 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5ab33690-24c5-44c9-9bde-eecaf511606e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:46.441281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1371/2747] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:46 2022] DELETE /identity/v3/projects/2fbdeaaacca54657aa5fbd70e052f3cc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:46.446740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d94e6-2d1d-41ea-8b66-2e6ddd93148a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:46.447209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d94e6-2d1d-41ea-8b66-2e6ddd93148a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:46.447319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d94e6-2d1d-41ea-8b66-2e6ddd93148a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:46.465885 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-617d94e6-2d1d-41ea-8b66-2e6ddd93148a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:46.467070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-617d94e6-2d1d-41ea-8b66-2e6ddd93148a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:46.526728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1377/2748] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:46.535565 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a60f-023a-463a-89f2-83c5e2c35d28 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:46.535861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a60f-023a-463a-89f2-83c5e2c35d28 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:46.536183 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a60f-023a-463a-89f2-83c5e2c35d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:46.556713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6489a60f-023a-463a-89f2-83c5e2c35d28 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:46.556713 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6489a60f-023a-463a-89f2-83c5e2c35d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:46.564108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1372/2749] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:46.569089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d94e6-2d1d-41ea-8b66-2e6ddd93148a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:46.578879 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d94e6-2d1d-41ea-8b66-2e6ddd93148a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:46.583450 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:46.584095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:46.584402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:46.584673 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:46.585393 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:46.585696 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:46.587270 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:46.598823 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1378/2750] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:46.603150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489a60f-023a-463a-89f2-83c5e2c35d28 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:46.612415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489a60f-023a-463a-89f2-83c5e2c35d28 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:46.618081 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae7c2-f1d0-4b19-ae85-517798d3b094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:46.618720 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae7c2-f1d0-4b19-ae85-517798d3b094 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:46.627798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae7c2-f1d0-4b19-ae85-517798d3b094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:46.627798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae7c2-f1d0-4b19-ae85-517798d3b094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:46.627798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae7c2-f1d0-4b19-ae85-517798d3b094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:46.627798 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae7c2-f1d0-4b19-ae85-517798d3b094 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:46.794839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1373/2751] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:46 2022] POST /identity/v3/projects => generated 376 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:46.798950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:46.810324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687be10-e1fc-47d3-b5fa-1562663306b5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:46.868540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d4219-ec6f-4a23-9538-a749c03901a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:46.869276 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d4219-ec6f-4a23-9538-a749c03901a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:46.869564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d4219-ec6f-4a23-9538-a749c03901a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:46.869838 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d4219-ec6f-4a23-9538-a749c03901a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:46.870532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d4219-ec6f-4a23-9538-a749c03901a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:46.872510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d4219-ec6f-4a23-9538-a749c03901a2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:47.020603 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1379/2752] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:46 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:47.022228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae7c2-f1d0-4b19-ae85-517798d3b094 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:47.034040 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae7c2-f1d0-4b19-ae85-517798d3b094 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:47.039880 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421653b-9df3-48af-ab10-dad0dc6d28d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:47.040945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421653b-9df3-48af-ab10-dad0dc6d28d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:47.040945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421653b-9df3-48af-ab10-dad0dc6d28d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:47.041136 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421653b-9df3-48af-ab10-dad0dc6d28d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:47.041884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421653b-9df3-48af-ab10-dad0dc6d28d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:47.043492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421653b-9df3-48af-ab10-dad0dc6d28d5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:47.056287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1374/2753] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:47 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:47.065564 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d4219-ec6f-4a23-9538-a749c03901a2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:47.088143 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d4219-ec6f-4a23-9538-a749c03901a2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:47.092922 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806c7a9-7ab1-4136-8f14-1d399637944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:47.093586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c7a9-7ab1-4136-8f14-1d399637944b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:47.093864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c7a9-7ab1-4136-8f14-1d399637944b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:47.094138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c7a9-7ab1-4136-8f14-1d399637944b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:47.094851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806c7a9-7ab1-4136-8f14-1d399637944b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:47.096467 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806c7a9-7ab1-4136-8f14-1d399637944b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:47.119841 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1380/2754] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:47 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:19:47.120011 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421653b-9df3-48af-ab10-dad0dc6d28d5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:47.123343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421653b-9df3-48af-ab10-dad0dc6d28d5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:47.127860 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:47.128769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:47.129191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:47.129466 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] PATH_INFO: `/v3/projects/8add8e9caa764002a54adceb1c977b58/users/c86797c892c44f548bcf9c7e27bb7dba/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:47.143779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8add8e9caa764002a54adceb1c977b58, user_id=c86797c892c44f548bcf9c7e27bb7dba, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:47.146507 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:47.303739 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1375/2755] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:47 2022] PUT /identity/v3/projects/8add8e9caa764002a54adceb1c977b58/users/c86797c892c44f548bcf9c7e27bb7dba/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:19:47.307767 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31986-b0cf-4c64-8b7f-6e24825c2f3a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:47.308055 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31986-b0cf-4c64-8b7f-6e24825c2f3a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:47.308379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31986-b0cf-4c64-8b7f-6e24825c2f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:47.341802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2ab31986-b0cf-4c64-8b7f-6e24825c2f3a None None] MFA Rules not processed for user `c86797c892c44f548bcf9c7e27bb7dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:47.341802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2ab31986-b0cf-4c64-8b7f-6e24825c2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:47.402960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1381/2756] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:47.437718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:47.439473 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:47.500540 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4f71-aa34-42b6-bcf9-f54ffd1ed01b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:47.504698 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:47.505342 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:47.505629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:47.505899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:47.514646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:47.516174 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:47.525926 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1376/2757] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:48.079158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:48.563677 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab31986-b0cf-4c64-8b7f-6e24825c2f3a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:48.565323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2ab31986-b0cf-4c64-8b7f-6e24825c2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:48.631852 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab31986-b0cf-4c64-8b7f-6e24825c2f3a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:48.636498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:48.637370 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:48.637653 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:48.637929 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] PATH_INFO: `/v3/users/d3ea5ae0fcce42229754d5b0d001fae2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:48.639127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ea5ae0fcce42229754d5b0d001fae2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:48.641096 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:48.785281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:48.786652 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:48.829939 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:48.844532 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e55e2-985f-4437-99f4-61b0bddff064 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:48.848266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d865f-73ab-4180-ac55-4c16cae6d978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:48.848922 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d865f-73ab-4180-ac55-4c16cae6d978 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:48.849199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d865f-73ab-4180-ac55-4c16cae6d978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:48.849470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d865f-73ab-4180-ac55-4c16cae6d978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:48.851228 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1f1d865f-73ab-4180-ac55-4c16cae6d978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:48.903136 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ea5ae0fcce42229754d5b0d001fae2'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:48.903807 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ea5ae0fcce42229754d5b0d001fae2'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:48.904924 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ea5ae0fcce42229754d5b0d001fae2'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:48.914419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d865f-73ab-4180-ac55-4c16cae6d978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:48.915881 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d865f-73ab-4180-ac55-4c16cae6d978 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:48.917814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ea5ae0fcce42229754d5b0d001fae2'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:48.924784 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ea5ae0fcce42229754d5b0d001fae2'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:48.926609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1377/2758] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:19:49.071238 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1382/2759] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:48 2022] DELETE /identity/v3/users/d3ea5ae0fcce42229754d5b0d001fae2 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:49.075775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ac73-8586-4283-9043-1ca33aad81d0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:49.076047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ac73-8586-4283-9043-1ca33aad81d0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:49.076338 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ac73-8586-4283-9043-1ca33aad81d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:49.093575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-86a6ac73-8586-4283-9043-1ca33aad81d0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:49.094771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-86a6ac73-8586-4283-9043-1ca33aad81d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:49.154711 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1378/2760] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:49.164633 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:49.166619 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:49.248258 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0058f9d-ee3b-4c1e-8b82-4095e5740912 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:49.252697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:49.254117 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:49.254550 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:49.254903 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:49.265890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:49.267563 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:49.278616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1383/2761] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:49.861730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ac73-8586-4283-9043-1ca33aad81d0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:49.867150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-86a6ac73-8586-4283-9043-1ca33aad81d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:49.879182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ac73-8586-4283-9043-1ca33aad81d0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:49.884715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:49.885583 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:49.885858 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:49.886179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] PATH_INFO: `/v3/projects/190f4fc6b1c84a498b455540624a457e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:49.888010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190f4fc6b1c84a498b455540624a457e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:49.890470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:50.045380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190f4fc6b1c84a498b455540624a457e', 'request_id': 'req-e2912530-e6bc-41a2-96fc-084640356849'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:50.192799 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190f4fc6b1c84a498b455540624a457e', 'request_id': 'req-e2912530-e6bc-41a2-96fc-084640356849'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:50.200231 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190f4fc6b1c84a498b455540624a457e', 'request_id': 'req-e2912530-e6bc-41a2-96fc-084640356849'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:50.213026 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] The token cache is being invalidate because project 190f4fc6b1c84a498b455540624a457e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:50.213318 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:50.214169 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:50.215741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1379/2762] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:49 2022] DELETE /identity/v3/projects/190f4fc6b1c84a498b455540624a457e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:51.244470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:51.245860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:51.266671 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:51.310380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeff3a-a37d-4232-959f-a4809dcda73e service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:51.360067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:51.360737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:51.361015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:51.361287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:51.363953 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:51.429326 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:51.430985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:51.443090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1384/2763] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:51.653533 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:51.655149 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:51.670256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:51.743084 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2912530-e6bc-41a2-96fc-084640356849 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:51.750628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2381e18-4a81-448f-9537-88a1406bc8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:51.751282 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381e18-4a81-448f-9537-88a1406bc8ec service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:51.751572 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381e18-4a81-448f-9537-88a1406bc8ec service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:51.752204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381e18-4a81-448f-9537-88a1406bc8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:51.754003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f2381e18-4a81-448f-9537-88a1406bc8ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:51.766298 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2381e18-4a81-448f-9537-88a1406bc8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:51.768042 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2381e18-4a81-448f-9537-88a1406bc8ec service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:51.779907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1380/2764] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:52.475815 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:52.477313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:52.544517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328bd32-5301-4899-a65a-4fe29d302ec3 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:52.549302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:52.550298 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:52.550581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:52.550861 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] PATH_INFO: `/v3/users/c86797c892c44f548bcf9c7e27bb7dba` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:52.552053 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86797c892c44f548bcf9c7e27bb7dba)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:52.554465 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:53.001049 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86797c892c44f548bcf9c7e27bb7dba'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:53.001828 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86797c892c44f548bcf9c7e27bb7dba'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:53.003102 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86797c892c44f548bcf9c7e27bb7dba'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:53.016475 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86797c892c44f548bcf9c7e27bb7dba'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:53.024948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86797c892c44f548bcf9c7e27bb7dba'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:53.158350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1385/2765] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:19:52 2022] DELETE /identity/v3/users/c86797c892c44f548bcf9c7e27bb7dba => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:53.166877 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040fc4a-e6cd-425a-a42d-2be7bcb2ef1a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:53.168092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040fc4a-e6cd-425a-a42d-2be7bcb2ef1a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:53.168685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040fc4a-e6cd-425a-a42d-2be7bcb2ef1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:53.192491 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2040fc4a-e6cd-425a-a42d-2be7bcb2ef1a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:53.193973 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2040fc4a-e6cd-425a-a42d-2be7bcb2ef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:53.256562 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1381/2766] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:53.266439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:53.267832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:53.345441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a7fe2-4e8b-4647-9915-dd23f9e166f2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:53.345441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246d44a-26c5-4811-9073-62138bf0635a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:53.345441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246d44a-26c5-4811-9073-62138bf0635a service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:53.345441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246d44a-26c5-4811-9073-62138bf0635a service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:53.345989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246d44a-26c5-4811-9073-62138bf0635a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:53.356764 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246d44a-26c5-4811-9073-62138bf0635a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:53.358146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246d44a-26c5-4811-9073-62138bf0635a service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:53.368284 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1386/2767] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:53.888993 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040fc4a-e6cd-425a-a42d-2be7bcb2ef1a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:53.890549 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2040fc4a-e6cd-425a-a42d-2be7bcb2ef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:53.903408 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040fc4a-e6cd-425a-a42d-2be7bcb2ef1a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:53.908018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:53.909118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:53.909402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:53.909678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] PATH_INFO: `/v3/projects/8add8e9caa764002a54adceb1c977b58` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:53.910864 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8add8e9caa764002a54adceb1c977b58)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:53.912873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:54.093563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8add8e9caa764002a54adceb1c977b58', 'request_id': 'req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:54.281556 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8add8e9caa764002a54adceb1c977b58', 'request_id': 'req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:54.289345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8add8e9caa764002a54adceb1c977b58', 'request_id': 'req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:54.300775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] The token cache is being invalidate because project 8add8e9caa764002a54adceb1c977b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:19:54.301059 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:54.301740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cffdbbe-4ec6-4409-a977-a0f1d8b32a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:19:54.303656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1382/2768] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:19:53 2022] DELETE /identity/v3/projects/8add8e9caa764002a54adceb1c977b58 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:54.308490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc5e65-11b4-4780-b370-efa22bc96098 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.308900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc5e65-11b4-4780-b370-efa22bc96098 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.309045 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc5e65-11b4-4780-b370-efa22bc96098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.329253 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ffcc5e65-11b4-4780-b370-efa22bc96098 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:54.330469 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ffcc5e65-11b4-4780-b370-efa22bc96098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:54.395005 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1387/2769] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:54.406143 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2ad87-3bb9-44af-87c7-fffe0715f87e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.406661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2ad87-3bb9-44af-87c7-fffe0715f87e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.407563 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2ad87-3bb9-44af-87c7-fffe0715f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.429529 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c4e2ad87-3bb9-44af-87c7-fffe0715f87e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:54.430752 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c4e2ad87-3bb9-44af-87c7-fffe0715f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:54.439131 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1383/2770] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:54.443419 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc5e65-11b4-4780-b370-efa22bc96098 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:54.454032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc5e65-11b4-4780-b370-efa22bc96098 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:54.459089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:54.459740 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.460021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.460287 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.461035 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:19:54.461335 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:54.462955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:54.475911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1388/2771] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:19:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:19:54.479722 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2ad87-3bb9-44af-87c7-fffe0715f87e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:54.492909 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2ad87-3bb9-44af-87c7-fffe0715f87e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:54.494811 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd175d-a9c4-4fae-b1e6-26933bd335c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:54.495465 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd175d-a9c4-4fae-b1e6-26933bd335c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.495749 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd175d-a9c4-4fae-b1e6-26933bd335c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.496027 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd175d-a9c4-4fae-b1e6-26933bd335c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.496779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd175d-a9c4-4fae-b1e6-26933bd335c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:54.498706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd175d-a9c4-4fae-b1e6-26933bd335c5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:54.688702 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1384/2772] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:19:54 2022] POST /identity/v3/projects => generated 384 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:54.693231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:54.703021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406268-4249-4ef1-9e5e-18968fe8c498 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:54.775361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18beda4-e57e-4574-a8a9-107933e28131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:54.776043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18beda4-e57e-4574-a8a9-107933e28131 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.776345 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18beda4-e57e-4574-a8a9-107933e28131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.776640 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18beda4-e57e-4574-a8a9-107933e28131 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.777436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18beda4-e57e-4574-a8a9-107933e28131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:54.779384 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18beda4-e57e-4574-a8a9-107933e28131 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:54.929849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1389/2773] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:19:54 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:19:54.933069 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd175d-a9c4-4fae-b1e6-26933bd335c5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:54.951426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd175d-a9c4-4fae-b1e6-26933bd335c5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:54.959490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf0124-c9fc-4770-9ecc-bad495ade2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:54.960199 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0124-c9fc-4770-9ecc-bad495ade2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.960513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0124-c9fc-4770-9ecc-bad495ade2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.960797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0124-c9fc-4770-9ecc-bad495ade2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.961530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf0124-c9fc-4770-9ecc-bad495ade2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:54.963197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf0124-c9fc-4770-9ecc-bad495ade2e2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:54.975475 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1385/2774] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:54 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:54.979586 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18beda4-e57e-4574-a8a9-107933e28131 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:54.990074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18beda4-e57e-4574-a8a9-107933e28131 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:54.994769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fb708-22c2-4cf6-9b29-0f3e80d783a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:54.995501 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb708-22c2-4cf6-9b29-0f3e80d783a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.995851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb708-22c2-4cf6-9b29-0f3e80d783a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.996212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb708-22c2-4cf6-9b29-0f3e80d783a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.997029 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fb708-22c2-4cf6-9b29-0f3e80d783a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:54.998699 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fb708-22c2-4cf6-9b29-0f3e80d783a8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:55.013803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1390/2775] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:19:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:19:55.016930 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf0124-c9fc-4770-9ecc-bad495ade2e2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:55.028374 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf0124-c9fc-4770-9ecc-bad495ade2e2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:55.033289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:55.034767 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:55.035079 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:55.035356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] PATH_INFO: `/v3/projects/d84c437938314ec78375a4201a5bfca4/users/e53c9435ac5d4a6d89e636bffe1147e8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:55.055635 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84c437938314ec78375a4201a5bfca4, user_id=e53c9435ac5d4a6d89e636bffe1147e8, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:55.058367 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:55.202889 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:55.209580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1386/2776] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:19:55 2022] PUT /identity/v3/projects/d84c437938314ec78375a4201a5bfca4/users/e53c9435ac5d4a6d89e636bffe1147e8/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:19:55.214611 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da53d-2b29-4f49-8842-da2a5bb89651 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:55.214870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da53d-2b29-4f49-8842-da2a5bb89651 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:55.215148 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da53d-2b29-4f49-8842-da2a5bb89651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:55.234115 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-074da53d-2b29-4f49-8842-da2a5bb89651 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:55.235304 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-074da53d-2b29-4f49-8842-da2a5bb89651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:55.296432 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1391/2777] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:55.308802 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:55.311294 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:55.378470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62646efe-8009-4ea0-a7ae-e79e68c39d73 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:55.382861 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:55.383675 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:55.383809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:55.384085 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:55.397273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:55.398884 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:55.409271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1387/2778] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:55.454351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:57.318581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01633-e3d6-4b8e-bd7d-b0034fd60df8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:57.319144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01633-e3d6-4b8e-bd7d-b0034fd60df8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:57.319306 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01633-e3d6-4b8e-bd7d-b0034fd60df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:57.347436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c3f01633-e3d6-4b8e-bd7d-b0034fd60df8 None None] MFA Rules not processed for user `e53c9435ac5d4a6d89e636bffe1147e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:57.348870 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c3f01633-e3d6-4b8e-bd7d-b0034fd60df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:57.415259 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1392/2779] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:57.426569 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:57.428037 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:57.488182 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96d4ed-f967-4e93-a9f4-161c73e31cab service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:57.492471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:57.493194 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:57.493470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:57.493740 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:57.503520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:57.504994 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:57.514180 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1388/2780] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:19:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:57.728114 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:00.789425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a1200-b061-487c-af4e-d017f7012e65 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:00.790068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a1200-b061-487c-af4e-d017f7012e65 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:00.790068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a1200-b061-487c-af4e-d017f7012e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:00.808338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-de7a1200-b061-487c-af4e-d017f7012e65 None None] MFA Rules not processed for user `e53c9435ac5d4a6d89e636bffe1147e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:00.809594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-de7a1200-b061-487c-af4e-d017f7012e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:00.817505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1393/2781] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:09.552957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:11.053110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:19.398745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:19.400220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:19.415781 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a83c4-edb1-4db9-b6ed-837242ab0c4b service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:19.420407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:19.421381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:19.422538 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:19.422814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] PATH_INFO: `/v3/users/e023551b159d45fda69f00d9ff9fbd30` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:19.424616 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e023551b159d45fda69f00d9ff9fbd30)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:19.426668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:19.767773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e023551b159d45fda69f00d9ff9fbd30'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:19.768772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e023551b159d45fda69f00d9ff9fbd30'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:19.769382 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e023551b159d45fda69f00d9ff9fbd30'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:19.782686 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e023551b159d45fda69f00d9ff9fbd30'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:19.795077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e023551b159d45fda69f00d9ff9fbd30'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:19.973765 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1389/2782] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:20:19 2022] DELETE /identity/v3/users/e023551b159d45fda69f00d9ff9fbd30 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:20.536554 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a1200-b061-487c-af4e-d017f7012e65 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:20.548796 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a1200-b061-487c-af4e-d017f7012e65 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:20.615320 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:20.616184 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:20.616517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:20.616811 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] PATH_INFO: `/v3/projects/f5acb0bcbf7947e1a3ee7453ef3be793` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:20.618040 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5acb0bcbf7947e1a3ee7453ef3be793)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:20.619949 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:20.803436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5acb0bcbf7947e1a3ee7453ef3be793', 'request_id': 'req-65f93325-e793-4e96-a71d-d6ce13e70889'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:20.892736 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5acb0bcbf7947e1a3ee7453ef3be793', 'request_id': 'req-65f93325-e793-4e96-a71d-d6ce13e70889'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:20.903383 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5acb0bcbf7947e1a3ee7453ef3be793', 'request_id': 'req-65f93325-e793-4e96-a71d-d6ce13e70889'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:20.915123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] The token cache is being invalidate because project f5acb0bcbf7947e1a3ee7453ef3be793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:20:20.915425 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:20.916134 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:20.918385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1394/2783] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:20:20 2022] DELETE /identity/v3/projects/f5acb0bcbf7947e1a3ee7453ef3be793 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:20.923746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:20.925425 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:20.939580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13ab62-f297-48ae-b900-05deb9ed5b90 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:21.013872 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:21.023339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:21.023339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:21.023339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] PATH_INFO: `/v3/users/b100f1366803463991dd1f5a8c81f5e1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:21.023339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b100f1366803463991dd1f5a8c81f5e1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:21.023339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:21.281020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b100f1366803463991dd1f5a8c81f5e1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:21.281784 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b100f1366803463991dd1f5a8c81f5e1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:21.282575 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b100f1366803463991dd1f5a8c81f5e1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:21.295148 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b100f1366803463991dd1f5a8c81f5e1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:21.303608 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8d134865-0819-45d6-9640-38c19193eb61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b100f1366803463991dd1f5a8c81f5e1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:21.305554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:21.455812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1390/2784] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:20:20 2022] DELETE /identity/v3/users/b100f1366803463991dd1f5a8c81f5e1 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:21.714604 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:21.716293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:21.730197 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93325-e793-4e96-a71d-d6ce13e70889 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:21.811510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:21.812994 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:21.813391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:21.813540 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] PATH_INFO: `/v3/projects/0dccf75d48834b5686eddbca272e5429` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:21.814789 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dccf75d48834b5686eddbca272e5429)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:21.816808 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:21.922504 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:21.935403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dccf75d48834b5686eddbca272e5429', 'request_id': 'req-d8123b55-e9b7-48dc-b301-658f60969c30'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:22.008769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dccf75d48834b5686eddbca272e5429', 'request_id': 'req-d8123b55-e9b7-48dc-b301-658f60969c30'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:22.018272 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dccf75d48834b5686eddbca272e5429', 'request_id': 'req-d8123b55-e9b7-48dc-b301-658f60969c30'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:22.030260 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] The token cache is being invalidate because project 0dccf75d48834b5686eddbca272e5429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:20:22.030534 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:22.032403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d8123b55-e9b7-48dc-b301-658f60969c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:22.034272 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1395/2785] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:20:21 2022] DELETE /identity/v3/projects/0dccf75d48834b5686eddbca272e5429 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:22.039176 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d136b4-fff7-44f2-b4ce-f02df7cc867b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.039636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d136b4-fff7-44f2-b4ce-f02df7cc867b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.039970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d136b4-fff7-44f2-b4ce-f02df7cc867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.059893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-67d136b4-fff7-44f2-b4ce-f02df7cc867b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:22.064613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-67d136b4-fff7-44f2-b4ce-f02df7cc867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:22.136381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1391/2786] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:22.146046 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e31a-47a2-458e-8d41-1b6c3e80d218 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.146477 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e31a-47a2-458e-8d41-1b6c3e80d218 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.146869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e31a-47a2-458e-8d41-1b6c3e80d218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.168835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9b40e31a-47a2-458e-8d41-1b6c3e80d218 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:22.170187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9b40e31a-47a2-458e-8d41-1b6c3e80d218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:22.180195 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1396/2787] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:22.184910 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d136b4-fff7-44f2-b4ce-f02df7cc867b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:22.195598 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d136b4-fff7-44f2-b4ce-f02df7cc867b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:22.201123 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:22.201934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.202380 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.202526 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.203946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:20:22.204264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:22.205908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:22.219988 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1392/2788] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:20:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:20:22.224122 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40e31a-47a2-458e-8d41-1b6c3e80d218 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:22.234864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40e31a-47a2-458e-8d41-1b6c3e80d218 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:22.240255 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2df90b-688b-4306-96c8-5e4657ffde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:22.240991 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df90b-688b-4306-96c8-5e4657ffde90 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.241254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df90b-688b-4306-96c8-5e4657ffde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.241535 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df90b-688b-4306-96c8-5e4657ffde90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.242232 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2df90b-688b-4306-96c8-5e4657ffde90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:22.244154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2df90b-688b-4306-96c8-5e4657ffde90 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:22.335282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1397/2789] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:20:22 2022] POST /identity/v3/projects => generated 374 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:20:22.339606 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:22.351083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a5397-af36-4619-871f-c55bd72bb934 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:22.414305 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd087a4-b84f-40d4-bd74-a8057137d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:22.415120 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd087a4-b84f-40d4-bd74-a8057137d942 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.415401 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd087a4-b84f-40d4-bd74-a8057137d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.415669 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd087a4-b84f-40d4-bd74-a8057137d942 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.416550 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd087a4-b84f-40d4-bd74-a8057137d942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:22.418966 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd087a4-b84f-40d4-bd74-a8057137d942 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:22.502444 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1393/2790] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:20:22 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:20:22.507641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2df90b-688b-4306-96c8-5e4657ffde90 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:22.523372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2df90b-688b-4306-96c8-5e4657ffde90 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:22.529261 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f671b4-66b6-4849-b43e-41b530ea87eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:22.530104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f671b4-66b6-4849-b43e-41b530ea87eb admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.530411 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f671b4-66b6-4849-b43e-41b530ea87eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.531309 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f671b4-66b6-4849-b43e-41b530ea87eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.532267 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f671b4-66b6-4849-b43e-41b530ea87eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:22.534960 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f671b4-66b6-4849-b43e-41b530ea87eb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:22.550389 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1398/2791] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:20:22 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:20:22.554536 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd087a4-b84f-40d4-bd74-a8057137d942 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:22.565596 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd087a4-b84f-40d4-bd74-a8057137d942 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:22.571108 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14918ca-b600-426c-9563-dee554390a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:22.572006 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14918ca-b600-426c-9563-dee554390a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.572478 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14918ca-b600-426c-9563-dee554390a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.572849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14918ca-b600-426c-9563-dee554390a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.574020 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14918ca-b600-426c-9563-dee554390a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:22.576751 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14918ca-b600-426c-9563-dee554390a92 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:22.591435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1394/2792] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:20:22 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:20:22.596553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f671b4-66b6-4849-b43e-41b530ea87eb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:22.607110 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f671b4-66b6-4849-b43e-41b530ea87eb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:22.612594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:22.613517 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.613797 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.614073 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] PATH_INFO: `/v3/projects/7e406919a35e4984ad694c67ae3122b4/users/683cc3736dd349cc9c37498fb3d3c585/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.629063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e406919a35e4984ad694c67ae3122b4, user_id=683cc3736dd349cc9c37498fb3d3c585, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:22.631774 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:22.710771 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1399/2793] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:20:22 2022] PUT /identity/v3/projects/7e406919a35e4984ad694c67ae3122b4/users/683cc3736dd349cc9c37498fb3d3c585/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:22.723558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd828-2211-412d-a87a-c48093383818 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.723843 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd828-2211-412d-a87a-c48093383818 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.724122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd828-2211-412d-a87a-c48093383818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.752236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-753dd828-2211-412d-a87a-c48093383818 None None] MFA Rules not processed for user `683cc3736dd349cc9c37498fb3d3c585`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:22.753506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-753dd828-2211-412d-a87a-c48093383818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:22.800595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:22.828836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1395/2794] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:22.839722 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:22.842391 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:22.904572 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ea8c-7ea1-4000-87a0-032b807778f4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:22.908437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c393c-8e93-4617-94b2-6c67067e4c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:22.909323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c393c-8e93-4617-94b2-6c67067e4c7f service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:22.909642 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c393c-8e93-4617-94b2-6c67067e4c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:22.909917 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c393c-8e93-4617-94b2-6c67067e4c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:22.918814 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c393c-8e93-4617-94b2-6c67067e4c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:22.920239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c393c-8e93-4617-94b2-6c67067e4c7f service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:22.931031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1400/2795] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:22.951776 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dd828-2211-412d-a87a-c48093383818 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:23.023730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dd828-2211-412d-a87a-c48093383818 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:23.028462 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:23.029356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:23.029637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:23.029911 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] PATH_INFO: `/v3/users/683cc3736dd349cc9c37498fb3d3c585` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:23.031396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=683cc3736dd349cc9c37498fb3d3c585)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:23.033627 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:23.388226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683cc3736dd349cc9c37498fb3d3c585'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:23.388990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683cc3736dd349cc9c37498fb3d3c585'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:23.389828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683cc3736dd349cc9c37498fb3d3c585'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:23.403600 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683cc3736dd349cc9c37498fb3d3c585'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:23.417334 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683cc3736dd349cc9c37498fb3d3c585'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:23.539760 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1396/2796] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:20:22 2022] DELETE /identity/v3/users/683cc3736dd349cc9c37498fb3d3c585 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:23.544324 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb4af-a6f7-4403-81bb-9a90df12ed09 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:23.544627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb4af-a6f7-4403-81bb-9a90df12ed09 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:23.544907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb4af-a6f7-4403-81bb-9a90df12ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:23.563908 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-26cdb4af-a6f7-4403-81bb-9a90df12ed09 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:23.565185 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-26cdb4af-a6f7-4403-81bb-9a90df12ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:23.620327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:23.628806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1401/2797] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:23.638980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:23.640293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:23.707810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa423a-cacf-4ff9-b417-b35b13b81a60 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:23.711443 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060cac5-269d-4b3c-aa57-9a586fdc6abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:23.712088 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060cac5-269d-4b3c-aa57-9a586fdc6abc service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:23.712413 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060cac5-269d-4b3c-aa57-9a586fdc6abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:23.712688 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060cac5-269d-4b3c-aa57-9a586fdc6abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:23.722445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060cac5-269d-4b3c-aa57-9a586fdc6abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:23.723888 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060cac5-269d-4b3c-aa57-9a586fdc6abc service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:23.733433 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1397/2798] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:24.165817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb4af-a6f7-4403-81bb-9a90df12ed09 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:24.165817 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-26cdb4af-a6f7-4403-81bb-9a90df12ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:24.171940 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb4af-a6f7-4403-81bb-9a90df12ed09 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:24.176882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:24.177762 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:24.178093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:24.178569 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] PATH_INFO: `/v3/projects/7e406919a35e4984ad694c67ae3122b4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:24.179768 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e406919a35e4984ad694c67ae3122b4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:24.181729 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:24.301974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e406919a35e4984ad694c67ae3122b4', 'request_id': 'req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:24.406844 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e406919a35e4984ad694c67ae3122b4', 'request_id': 'req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:24.413695 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e406919a35e4984ad694c67ae3122b4', 'request_id': 'req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:24.425351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] The token cache is being invalidate because project 7e406919a35e4984ad694c67ae3122b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:20:24.425620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:24.426274 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3cf2bb8a-c3a5-4c16-bb78-f0ceba6f931d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:24.428064 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1402/2799] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:20:24 2022] DELETE /identity/v3/projects/7e406919a35e4984ad694c67ae3122b4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:24.433761 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638b521-8f32-4d8b-9bcf-215d9ef87569 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:24.434337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638b521-8f32-4d8b-9bcf-215d9ef87569 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:24.434337 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638b521-8f32-4d8b-9bcf-215d9ef87569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:24.456082 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6638b521-8f32-4d8b-9bcf-215d9ef87569 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:24.457949 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6638b521-8f32-4d8b-9bcf-215d9ef87569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:24.463256 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:24.531264 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1398/2800] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:24.543494 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede3923-dae7-42c6-bb71-fab14fa8de70 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:24.543918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede3923-dae7-42c6-bb71-fab14fa8de70 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:24.544560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede3923-dae7-42c6-bb71-fab14fa8de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:24.565322 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6ede3923-dae7-42c6-bb71-fab14fa8de70 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:24.566691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6ede3923-dae7-42c6-bb71-fab14fa8de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:24.581133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1403/2801] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:24.582441 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638b521-8f32-4d8b-9bcf-215d9ef87569 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:24.596830 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638b521-8f32-4d8b-9bcf-215d9ef87569 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:24.601580 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:24.602236 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:24.602516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:24.602789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:24.603514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:20:24.603817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:24.605471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:24.621667 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1399/2802] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:20:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:20:24.625363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede3923-dae7-42c6-bb71-fab14fa8de70 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:24.635848 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede3923-dae7-42c6-bb71-fab14fa8de70 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:24.641728 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1f59f-977e-4c1a-8b91-84514265ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:24.642557 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1f59f-977e-4c1a-8b91-84514265ee11 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:24.642925 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1f59f-977e-4c1a-8b91-84514265ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:24.643245 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1f59f-977e-4c1a-8b91-84514265ee11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:24.644138 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1f59f-977e-4c1a-8b91-84514265ee11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:24.646543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1f59f-977e-4c1a-8b91-84514265ee11 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:24.743218 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1404/2803] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:20:24 2022] POST /identity/v3/projects => generated 372 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:20:24.747672 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:24.759619 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f215-1cad-495b-b15c-a5ab0ce5cb3d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:24.820415 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef286b-f9ad-4acf-93f0-b8b2185331b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:24.821238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef286b-f9ad-4acf-93f0-b8b2185331b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:24.821524 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef286b-f9ad-4acf-93f0-b8b2185331b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:24.821850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef286b-f9ad-4acf-93f0-b8b2185331b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:24.822585 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef286b-f9ad-4acf-93f0-b8b2185331b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:24.824788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef286b-f9ad-4acf-93f0-b8b2185331b8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:24.949459 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1400/2804] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:20:24 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:20:24.953884 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1f59f-977e-4c1a-8b91-84514265ee11 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:24.964731 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1f59f-977e-4c1a-8b91-84514265ee11 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:24.970348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf0ac-0125-4b6a-883d-8142425b66de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:24.971041 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf0ac-0125-4b6a-883d-8142425b66de admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:24.971323 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf0ac-0125-4b6a-883d-8142425b66de admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:24.971598 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcf0ac-0125-4b6a-883d-8142425b66de admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:24.972361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcf0ac-0125-4b6a-883d-8142425b66de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:24.973981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcf0ac-0125-4b6a-883d-8142425b66de admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:24.985947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1405/2805] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:20:24 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:20:24.990789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef286b-f9ad-4acf-93f0-b8b2185331b8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:25.002568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef286b-f9ad-4acf-93f0-b8b2185331b8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:25.008003 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338ca09-05c3-48b7-953d-753bcf5e8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:25.009044 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ca09-05c3-48b7-953d-753bcf5e8f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:25.009560 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ca09-05c3-48b7-953d-753bcf5e8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:25.010002 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338ca09-05c3-48b7-953d-753bcf5e8f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:25.011184 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338ca09-05c3-48b7-953d-753bcf5e8f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:25.013741 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338ca09-05c3-48b7-953d-753bcf5e8f55 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:25.028558 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1401/2806] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:20:24 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:20:25.033387 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf0ac-0125-4b6a-883d-8142425b66de admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:25.043990 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcf0ac-0125-4b6a-883d-8142425b66de admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:25.049907 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:25.050788 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:25.051069 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:25.051347 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] PATH_INFO: `/v3/projects/54ff6663bc63416ea94ae564a3227d7a/users/204e5bdeaef14488b42dd1ef0e4a0bb7/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:25.068575 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ff6663bc63416ea94ae564a3227d7a, user_id=204e5bdeaef14488b42dd1ef0e4a0bb7, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:25.071338 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:25.145854 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1406/2807] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:20:25 2022] PUT /identity/v3/projects/54ff6663bc63416ea94ae564a3227d7a/users/204e5bdeaef14488b42dd1ef0e4a0bb7/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:25.157523 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30921-15d7-4307-814f-ebca06c999e3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:25.158039 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30921-15d7-4307-814f-ebca06c999e3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:25.158434 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30921-15d7-4307-814f-ebca06c999e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:25.189125 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c9e30921-15d7-4307-814f-ebca06c999e3 None None] MFA Rules not processed for user `204e5bdeaef14488b42dd1ef0e4a0bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:25.190676 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c9e30921-15d7-4307-814f-ebca06c999e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:25.264487 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1402/2808] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:25.274966 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:25.277095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:25.341955 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044d68f-27d8-49d4-b375-25c084ff2ad2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:25.347241 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f561d-3d52-4a5e-9e17-764b8edc5f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:25.347918 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f561d-3d52-4a5e-9e17-764b8edc5f80 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:25.348194 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f561d-3d52-4a5e-9e17-764b8edc5f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:25.348500 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f561d-3d52-4a5e-9e17-764b8edc5f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:25.358897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f561d-3d52-4a5e-9e17-764b8edc5f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:25.360651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f561d-3d52-4a5e-9e17-764b8edc5f80 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:25.369911 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1407/2809] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:25.407273 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e30921-15d7-4307-814f-ebca06c999e3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:25.413099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:25.483983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e30921-15d7-4307-814f-ebca06c999e3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:25.488954 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:25.489844 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:25.490121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:25.490389 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] PATH_INFO: `/v3/users/204e5bdeaef14488b42dd1ef0e4a0bb7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:25.491892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204e5bdeaef14488b42dd1ef0e4a0bb7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:25.493899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:25.770245 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204e5bdeaef14488b42dd1ef0e4a0bb7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:25.770974 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204e5bdeaef14488b42dd1ef0e4a0bb7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:25.771567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204e5bdeaef14488b42dd1ef0e4a0bb7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:25.790452 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204e5bdeaef14488b42dd1ef0e4a0bb7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:25.798874 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204e5bdeaef14488b42dd1ef0e4a0bb7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:25.934135 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1403/2810] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:20:25 2022] DELETE /identity/v3/users/204e5bdeaef14488b42dd1ef0e4a0bb7 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:20:25.939968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10120eb-4fb4-4373-94b5-d8ed7df3af1f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:25.940396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10120eb-4fb4-4373-94b5-d8ed7df3af1f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:25.940682 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10120eb-4fb4-4373-94b5-d8ed7df3af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:25.960853 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e10120eb-4fb4-4373-94b5-d8ed7df3af1f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:25.962402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e10120eb-4fb4-4373-94b5-d8ed7df3af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:25.987379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:26.036506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1408/2811] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:26.049490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:26.050991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:26.117668 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6948-8195-42e3-8ce6-d7b0c5d207b8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:26.121451 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6717e7-9edb-4413-99ec-a130e1dcfb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:26.122103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6717e7-9edb-4413-99ec-a130e1dcfb69 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:26.122387 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6717e7-9edb-4413-99ec-a130e1dcfb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:26.122658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6717e7-9edb-4413-99ec-a130e1dcfb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:26.134595 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6717e7-9edb-4413-99ec-a130e1dcfb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:26.135828 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6717e7-9edb-4413-99ec-a130e1dcfb69 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:26.147115 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1404/2812] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:20:26.710969 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10120eb-4fb4-4373-94b5-d8ed7df3af1f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:26.712471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e10120eb-4fb4-4373-94b5-d8ed7df3af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:26.727067 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10120eb-4fb4-4373-94b5-d8ed7df3af1f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:26.734956 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:26.735982 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:26.736380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:26.736660 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] PATH_INFO: `/v3/projects/54ff6663bc63416ea94ae564a3227d7a` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:26.737968 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ff6663bc63416ea94ae564a3227d7a)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:26.739937 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:26.913257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ff6663bc63416ea94ae564a3227d7a', 'request_id': 'req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:27.103279 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ff6663bc63416ea94ae564a3227d7a', 'request_id': 'req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:27.110974 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ff6663bc63416ea94ae564a3227d7a', 'request_id': 'req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:27.121430 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] The token cache is being invalidate because project 54ff6663bc63416ea94ae564a3227d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:20:27.121787 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:27.148039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-05214ffc-5f8b-4551-9dcc-d82a2fa1fc59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:27.148039 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1409/2813] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:20:26 2022] DELETE /identity/v3/projects/54ff6663bc63416ea94ae564a3227d7a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:27.151983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084e17-7217-4cf5-ab89-483230528693 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:27.152480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084e17-7217-4cf5-ab89-483230528693 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:27.152577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084e17-7217-4cf5-ab89-483230528693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:27.172639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-22084e17-7217-4cf5-ab89-483230528693 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:27.173835 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-22084e17-7217-4cf5-ab89-483230528693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:27.195649 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:27.236715 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1405/2814] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:27.244790 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008096-f3d8-4197-8fee-8a61ed839ac6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:27.245036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008096-f3d8-4197-8fee-8a61ed839ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:27.245316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008096-f3d8-4197-8fee-8a61ed839ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:27.265285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7f008096-f3d8-4197-8fee-8a61ed839ac6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:27.266506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7f008096-f3d8-4197-8fee-8a61ed839ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:27.274970 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1410/2815] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:27.279144 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084e17-7217-4cf5-ab89-483230528693 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:27.289326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084e17-7217-4cf5-ab89-483230528693 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:27.293915 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:27.294570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:27.294847 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:27.295117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:27.296356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:20:27.296666 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:27.298269 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:27.311825 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1406/2816] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:20:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:20:27.322471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008096-f3d8-4197-8fee-8a61ed839ac6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:27.332886 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008096-f3d8-4197-8fee-8a61ed839ac6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:27.338060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5afd-398f-463c-9350-51c5459b4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:27.338839 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5afd-398f-463c-9350-51c5459b4084 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:27.339106 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5afd-398f-463c-9350-51c5459b4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:27.339403 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5afd-398f-463c-9350-51c5459b4084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:27.340090 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a5afd-398f-463c-9350-51c5459b4084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:27.342089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a5afd-398f-463c-9350-51c5459b4084 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:27.506580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1411/2817] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:20:27 2022] POST /identity/v3/projects => generated 376 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:20:27.511769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:27.522821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d4e73-58af-4fac-9282-637afa2ba24e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:27.579271 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb649d1-ecd4-4d19-bfb1-3c1b3bf3eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:27.579933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb649d1-ecd4-4d19-bfb1-3c1b3bf3eb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:27.580209 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb649d1-ecd4-4d19-bfb1-3c1b3bf3eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:27.580508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb649d1-ecd4-4d19-bfb1-3c1b3bf3eb8c admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:27.581191 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb649d1-ecd4-4d19-bfb1-3c1b3bf3eb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:27.583121 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb649d1-ecd4-4d19-bfb1-3c1b3bf3eb8c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:27.714445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1407/2818] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:20:27 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:20:27.718560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5afd-398f-463c-9350-51c5459b4084 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:27.728988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5afd-398f-463c-9350-51c5459b4084 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:27.734063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8119ca-7c13-49ad-9c20-43659f2cf9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:27.734860 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8119ca-7c13-49ad-9c20-43659f2cf9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:27.735141 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8119ca-7c13-49ad-9c20-43659f2cf9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:27.735412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8119ca-7c13-49ad-9c20-43659f2cf9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:27.736126 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8119ca-7c13-49ad-9c20-43659f2cf9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:27.737871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8119ca-7c13-49ad-9c20-43659f2cf9f3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:27.748948 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1412/2819] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:20:27 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:20:27.753313 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb649d1-ecd4-4d19-bfb1-3c1b3bf3eb8c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:27.763574 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb649d1-ecd4-4d19-bfb1-3c1b3bf3eb8c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:27.768056 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c862a8-00d3-489f-9cff-e5cab1b72717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:27.768731 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c862a8-00d3-489f-9cff-e5cab1b72717 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:27.769008 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c862a8-00d3-489f-9cff-e5cab1b72717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:27.769281 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c862a8-00d3-489f-9cff-e5cab1b72717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:27.769991 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c862a8-00d3-489f-9cff-e5cab1b72717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:27.771613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c862a8-00d3-489f-9cff-e5cab1b72717 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:27.786048 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1408/2820] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:20:27 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:20:27.787198 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8119ca-7c13-49ad-9c20-43659f2cf9f3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:27.798614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8119ca-7c13-49ad-9c20-43659f2cf9f3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:27.803587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:27.804532 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:27.804816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:27.805105 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] PATH_INFO: `/v3/projects/4189e414d0854301846b516078796c2b/users/fe3180e04dae4e74815fb69596f6474b/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:27.820915 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4189e414d0854301846b516078796c2b, user_id=fe3180e04dae4e74815fb69596f6474b, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:27.823574 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:28.013269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1413/2821] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:20:27 2022] PUT /identity/v3/projects/4189e414d0854301846b516078796c2b/users/fe3180e04dae4e74815fb69596f6474b/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:20:28.027316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efd993-9900-4beb-b4d2-b6e2c64c0ea6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:28.027316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efd993-9900-4beb-b4d2-b6e2c64c0ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:28.027316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efd993-9900-4beb-b4d2-b6e2c64c0ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:28.052736 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c3efd993-9900-4beb-b4d2-b6e2c64c0ea6 None None] MFA Rules not processed for user `fe3180e04dae4e74815fb69596f6474b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:28.053941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c3efd993-9900-4beb-b4d2-b6e2c64c0ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:28.143601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1409/2822] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:28.155754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:28.157617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:28.207758 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:28.220510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44b646-f87e-4e98-a1fe-1676b5951f61 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:28.224156 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:28.224851 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:28.225150 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:28.225414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:28.234547 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:28.235975 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:28.244930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1414/2823] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:30.319244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f552-4fe1-4445-b555-c370483ef3f5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:30.319773 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f552-4fe1-4445-b555-c370483ef3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:30.319984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f552-4fe1-4445-b555-c370483ef3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:30.338312 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2639f552-4fe1-4445-b555-c370483ef3f5 None None] MFA Rules not processed for user `fe3180e04dae4e74815fb69596f6474b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:30.339494 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2639f552-4fe1-4445-b555-c370483ef3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:30.347331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1410/2824] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:32.976691 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:32.977769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:33.052548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130b76-40f9-4f14-ba50-37f213c7b3ae service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:33.059410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:33.059410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:33.059410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:33.059410 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:33.061160 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:33.074530 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:33.076380 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:33.087292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1415/2825] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:35.986545 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f076d9-ae7c-4e0c-8bb7-06efc8558099 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:35.987116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f076d9-ae7c-4e0c-8bb7-06efc8558099 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:35.987226 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f076d9-ae7c-4e0c-8bb7-06efc8558099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:36.007554 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c2f076d9-ae7c-4e0c-8bb7-06efc8558099 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:36.009893 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c2f076d9-ae7c-4e0c-8bb7-06efc8558099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:36.019957 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:36.074886 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1411/2826] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:36.089750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:36.091498 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:36.173210 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe11d4-ce14-4c9a-993e-cbc8cbd1d94e service placement] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:36.178832 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b70d27-c677-40e6-8c65-90e40fafd006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:36.179525 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70d27-c677-40e6-8c65-90e40fafd006 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:36.179806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70d27-c677-40e6-8c65-90e40fafd006 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:36.180083 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70d27-c677-40e6-8c65-90e40fafd006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:36.191100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b70d27-c677-40e6-8c65-90e40fafd006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:36.192816 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b70d27-c677-40e6-8c65-90e40fafd006 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:36.203717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1416/2827] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:41.290609 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ff6-4359-4d5c-992e-06fb5d7aeb47 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:41.291155 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ff6-4359-4d5c-992e-06fb5d7aeb47 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:41.291155 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ff6-4359-4d5c-992e-06fb5d7aeb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:41.311997 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f0f47ff6-4359-4d5c-992e-06fb5d7aeb47 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:41.313410 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f0f47ff6-4359-4d5c-992e-06fb5d7aeb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:41.323025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1412/2828] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:41.347785 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b70d27-c677-40e6-8c65-90e40fafd006 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:41.359002 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b70d27-c677-40e6-8c65-90e40fafd006 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:41.365488 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:41.366657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:41.366657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:41.366657 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:41.375213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:41.377492 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:41.388226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1417/2829] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:45.099402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4605e9-6189-4885-a7e0-90be04edaa2f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:45.099945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4605e9-6189-4885-a7e0-90be04edaa2f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:45.099945 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4605e9-6189-4885-a7e0-90be04edaa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:45.118095 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-de4605e9-6189-4885-a7e0-90be04edaa2f None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:45.119238 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-de4605e9-6189-4885-a7e0-90be04edaa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:45.126984 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1413/2830] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:45.145158 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:45.146606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:45.162149 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e45f0-f67a-40a3-a1c4-b7c777adba66 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:45.167632 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39f61-5fce-4f86-b623-c3c6bbb634a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:45.168551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39f61-5fce-4f86-b623-c3c6bbb634a0 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:45.168830 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39f61-5fce-4f86-b623-c3c6bbb634a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:45.169101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39f61-5fce-4f86-b623-c3c6bbb634a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:45.177390 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb39f61-5fce-4f86-b623-c3c6bbb634a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:45.178950 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb39f61-5fce-4f86-b623-c3c6bbb634a0 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:45.188215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1418/2831] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:48.852205 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264c884-8218-4826-a520-de8acc17a1ba None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:48.852788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264c884-8218-4826-a520-de8acc17a1ba None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:48.852905 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264c884-8218-4826-a520-de8acc17a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:48.873158 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7264c884-8218-4826-a520-de8acc17a1ba None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:48.874375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7264c884-8218-4826-a520-de8acc17a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:48.883547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1414/2832] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:48.905548 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39f61-5fce-4f86-b623-c3c6bbb634a0 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:48.917827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39f61-5fce-4f86-b623-c3c6bbb634a0 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:48.924404 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16163d68-fd03-4f29-a843-d259a968d72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:48.924733 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163d68-fd03-4f29-a843-d259a968d72a service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:48.925154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163d68-fd03-4f29-a843-d259a968d72a service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:48.925436 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163d68-fd03-4f29-a843-d259a968d72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:48.934905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16163d68-fd03-4f29-a843-d259a968d72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:48.936687 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16163d68-fd03-4f29-a843-d259a968d72a service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:48.947363 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1419/2833] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:52.163544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0cf4-29c8-4582-ac25-5fdbefcb109a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:52.164049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0cf4-29c8-4582-ac25-5fdbefcb109a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:52.164167 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded0cf4-29c8-4582-ac25-5fdbefcb109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:52.185301 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9ded0cf4-29c8-4582-ac25-5fdbefcb109a None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:52.186520 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9ded0cf4-29c8-4582-ac25-5fdbefcb109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:52.194447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1415/2834] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:52.212024 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16163d68-fd03-4f29-a843-d259a968d72a service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:52.224213 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16163d68-fd03-4f29-a843-d259a968d72a service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:52.229755 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:52.230392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:52.230672 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:52.230985 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:52.240231 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:52.241843 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:52.251810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1420/2835] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:52.755763 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9f069-5888-46a9-aff0-cf7843385cfe None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:52.756047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9f069-5888-46a9-aff0-cf7843385cfe None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:52.756351 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9f069-5888-46a9-aff0-cf7843385cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:52.774323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-dfa9f069-5888-46a9-aff0-cf7843385cfe None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:52.775498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dfa9f069-5888-46a9-aff0-cf7843385cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:52.829431 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1416/2836] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:52.870654 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:52.872047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:52.882623 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:52.942233 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038530-23a8-43c5-bca1-743dbd5c39be service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:52.947265 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34a7b5-ffa4-4d98-8401-07cdc27cb145 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:52.947943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34a7b5-ffa4-4d98-8401-07cdc27cb145 service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:52.948221 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34a7b5-ffa4-4d98-8401-07cdc27cb145 service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:52.948526 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34a7b5-ffa4-4d98-8401-07cdc27cb145 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:52.956486 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34a7b5-ffa4-4d98-8401-07cdc27cb145 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:52.958205 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34a7b5-ffa4-4d98-8401-07cdc27cb145 service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:52.966602 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1421/2837] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:20:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:20:53.964139 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbc3c0-0919-4696-a42e-6e478e44c478 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:53.964612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbc3c0-0919-4696-a42e-6e478e44c478 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:53.964706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbc3c0-0919-4696-a42e-6e478e44c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:53.985614 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e8fbc3c0-0919-4696-a42e-6e478e44c478 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:53.987018 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e8fbc3c0-0919-4696-a42e-6e478e44c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:53.994745 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1417/2838] 10.222.0.123 () {58 vars in 972 bytes} [Thu May 26 18:20:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:54.007635 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34a7b5-ffa4-4d98-8401-07cdc27cb145 service swift] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:54.018392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34a7b5-ffa4-4d98-8401-07cdc27cb145 service swift] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:54.023546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066847-bd79-4f3a-bef7-02cb85f4ce45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:54.024187 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066847-bd79-4f3a-bef7-02cb85f4ce45 service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:54.024505 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066847-bd79-4f3a-bef7-02cb85f4ce45 service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:54.024782 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066847-bd79-4f3a-bef7-02cb85f4ce45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:54.033372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066847-bd79-4f3a-bef7-02cb85f4ce45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:54.034946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066847-bd79-4f3a-bef7-02cb85f4ce45 service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:54.043357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1422/2839] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:20:54.917339 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703f68-61fd-453b-9283-b244b3459739 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:54.917656 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703f68-61fd-453b-9283-b244b3459739 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:54.917901 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703f68-61fd-453b-9283-b244b3459739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:54.936172 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8f703f68-61fd-453b-9283-b244b3459739 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:54.937392 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8f703f68-61fd-453b-9283-b244b3459739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:54.944873 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1418/2840] 10.222.0.123 () {58 vars in 1014 bytes} [Thu May 26 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:54.956747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066847-bd79-4f3a-bef7-02cb85f4ce45 service swift] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:54.968085 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066847-bd79-4f3a-bef7-02cb85f4ce45 service swift] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:54.973186 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b751d-d3be-4d0f-926e-720f2990996c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:54.974420 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b751d-d3be-4d0f-926e-720f2990996c service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:54.974734 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b751d-d3be-4d0f-926e-720f2990996c service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:54.975012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b751d-d3be-4d0f-926e-720f2990996c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:54.983201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b751d-d3be-4d0f-926e-720f2990996c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:54.984802 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b751d-d3be-4d0f-926e-720f2990996c service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:54.993392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1423/2841] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:20:55.382940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4a72-58a4-43cf-b0d1-0bba9628725b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:55.383406 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4a72-58a4-43cf-b0d1-0bba9628725b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:55.383513 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4a72-58a4-43cf-b0d1-0bba9628725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:55.402122 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5b7e4a72-58a4-43cf-b0d1-0bba9628725b None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:55.403314 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5b7e4a72-58a4-43cf-b0d1-0bba9628725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:55.411817 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1419/2842] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:55.432503 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b751d-d3be-4d0f-926e-720f2990996c service swift] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:55.445272 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b751d-d3be-4d0f-926e-720f2990996c service swift] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:55.450702 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdf7ae-4d55-4aff-b480-7793fdcd3175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:55.451332 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdf7ae-4d55-4aff-b480-7793fdcd3175 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:55.451609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdf7ae-4d55-4aff-b480-7793fdcd3175 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:55.451882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdf7ae-4d55-4aff-b480-7793fdcd3175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:55.460820 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdf7ae-4d55-4aff-b480-7793fdcd3175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:55.462382 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdf7ae-4d55-4aff-b480-7793fdcd3175 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:55.471846 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1424/2843] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:55.735258 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5ddb-2a55-4899-9bf3-740357934c20 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:55.735546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5ddb-2a55-4899-9bf3-740357934c20 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:55.735821 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5ddb-2a55-4899-9bf3-740357934c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:55.753814 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d76d5ddb-2a55-4899-9bf3-740357934c20 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:55.755639 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d76d5ddb-2a55-4899-9bf3-740357934c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:55.762727 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1420/2844] 10.222.0.123 () {58 vars in 972 bytes} [Thu May 26 18:20:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:55.775973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdf7ae-4d55-4aff-b480-7793fdcd3175 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:55.785847 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdf7ae-4d55-4aff-b480-7793fdcd3175 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:55.791637 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d359-f3ab-475e-be7c-a03633643cb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:55.792263 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d359-f3ab-475e-be7c-a03633643cb6 service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:55.792577 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d359-f3ab-475e-be7c-a03633643cb6 service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:55.792894 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d359-f3ab-475e-be7c-a03633643cb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:55.801932 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d359-f3ab-475e-be7c-a03633643cb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:55.803697 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d359-f3ab-475e-be7c-a03633643cb6 service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:55.812017 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1425/2845] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:20:58.659512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d5ddb-2a55-4899-9bf3-740357934c20 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:58.671762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d5ddb-2a55-4899-9bf3-740357934c20 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:58.676262 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:58.677159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:58.677938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:58.678340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] PATH_INFO: `/v3/users/fe3180e04dae4e74815fb69596f6474b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:58.680052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3180e04dae4e74815fb69596f6474b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:58.683812 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:58.993312 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3180e04dae4e74815fb69596f6474b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:58.993946 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3180e04dae4e74815fb69596f6474b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:58.994705 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3180e04dae4e74815fb69596f6474b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:59.006789 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:59.008233 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3180e04dae4e74815fb69596f6474b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:59.015603 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3180e04dae4e74815fb69596f6474b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:59.195225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1421/2846] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:20:58 2022] DELETE /identity/v3/users/fe3180e04dae4e74815fb69596f6474b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:59.199869 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ba6c-7fbd-4f57-a4c7-a1a0cb583d95 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:59.200342 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ba6c-7fbd-4f57-a4c7-a1a0cb583d95 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:59.200507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ba6c-7fbd-4f57-a4c7-a1a0cb583d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:59.218140 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4678ba6c-7fbd-4f57-a4c7-a1a0cb583d95 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:59.219372 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4678ba6c-7fbd-4f57-a4c7-a1a0cb583d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:59.277827 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1426/2847] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:20:59.287399 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:59.289394 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:59.352419 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489820a0-8764-4373-b7db-f373a0d0a9a0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:59.355990 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0be6c-f8ee-4b32-b5f9-a0607278ed9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:59.356670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0be6c-f8ee-4b32-b5f9-a0607278ed9a service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:59.356951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0be6c-f8ee-4b32-b5f9-a0607278ed9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:59.357255 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0be6c-f8ee-4b32-b5f9-a0607278ed9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:59.367876 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0be6c-f8ee-4b32-b5f9-a0607278ed9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:59.369356 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0be6c-f8ee-4b32-b5f9-a0607278ed9a service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:59.379289 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1422/2848] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:20:59.640457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678ba6c-7fbd-4f57-a4c7-a1a0cb583d95 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:20:59.640457 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4678ba6c-7fbd-4f57-a4c7-a1a0cb583d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:20:59.651080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678ba6c-7fbd-4f57-a4c7-a1a0cb583d95 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:20:59.655993 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:20:59.656887 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:59.657162 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:59.657438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] PATH_INFO: `/v3/projects/4189e414d0854301846b516078796c2b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:59.658641 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4189e414d0854301846b516078796c2b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:20:59.660601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:20:59.822350 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:59.829209 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4189e414d0854301846b516078796c2b', 'request_id': 'req-c187866d-bb29-4848-8626-5f9d364230c6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:59.948570 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4189e414d0854301846b516078796c2b', 'request_id': 'req-c187866d-bb29-4848-8626-5f9d364230c6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:59.956012 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4189e414d0854301846b516078796c2b', 'request_id': 'req-c187866d-bb29-4848-8626-5f9d364230c6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:59.967346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] The token cache is being invalidate because project 4189e414d0854301846b516078796c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:20:59.967638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:59.968286 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c187866d-bb29-4848-8626-5f9d364230c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:20:59.969928 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1427/2849] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:20:59 2022] DELETE /identity/v3/projects/4189e414d0854301846b516078796c2b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:20:59.977254 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbcb9-c82b-477a-ac1c-05bfabd4a8b0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:20:59.977808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbcb9-c82b-477a-ac1c-05bfabd4a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:20:59.977808 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbcb9-c82b-477a-ac1c-05bfabd4a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:20:59.996460 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-619dbcb9-c82b-477a-ac1c-05bfabd4a8b0 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:20:59.997650 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-619dbcb9-c82b-477a-ac1c-05bfabd4a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:00.061103 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1423/2850] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:00.069063 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaa7e-6bb6-40d0-b62f-e3b31097fada None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:00.069351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaa7e-6bb6-40d0-b62f-e3b31097fada None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:00.069638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaa7e-6bb6-40d0-b62f-e3b31097fada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:00.088711 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3bbeaa7e-6bb6-40d0-b62f-e3b31097fada None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:00.089941 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3bbeaa7e-6bb6-40d0-b62f-e3b31097fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:00.098264 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1428/2851] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:00.103336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dbcb9-c82b-477a-ac1c-05bfabd4a8b0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:00.112965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dbcb9-c82b-477a-ac1c-05bfabd4a8b0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:00.118566 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:00.123772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:00.123772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:00.123772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:00.123772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:00.123772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:00.123772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:00.134469 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1424/2852] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:21:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:00.138676 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeaa7e-6bb6-40d0-b62f-e3b31097fada None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:00.148414 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeaa7e-6bb6-40d0-b62f-e3b31097fada None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:00.153130 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534f4bb-2d34-498f-9a6a-5b917276eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:00.153776 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f4bb-2d34-498f-9a6a-5b917276eaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:00.154059 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f4bb-2d34-498f-9a6a-5b917276eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:00.154336 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f4bb-2d34-498f-9a6a-5b917276eaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:00.155032 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534f4bb-2d34-498f-9a6a-5b917276eaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:00.156973 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534f4bb-2d34-498f-9a6a-5b917276eaa3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:00.278119 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1429/2853] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:21:00 2022] POST /identity/v3/projects => generated 372 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:00.283770 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:00.294952 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc44798-fd9d-4617-a483-700ae91597d3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:00.354730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad3ee-de91-4bb1-abcd-a10f1ffe6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:00.355489 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad3ee-de91-4bb1-abcd-a10f1ffe6b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:00.355793 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad3ee-de91-4bb1-abcd-a10f1ffe6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:00.356067 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ad3ee-de91-4bb1-abcd-a10f1ffe6b2e admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:00.356863 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ad3ee-de91-4bb1-abcd-a10f1ffe6b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:00.358983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ad3ee-de91-4bb1-abcd-a10f1ffe6b2e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:00.519384 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:00.527074 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1425/2854] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:21:00 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:00.532836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534f4bb-2d34-498f-9a6a-5b917276eaa3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:00.540822 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534f4bb-2d34-498f-9a6a-5b917276eaa3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:00.546441 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cbd08-486a-4da0-a5e8-f50d743cc945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:00.547101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cbd08-486a-4da0-a5e8-f50d743cc945 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:00.547379 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cbd08-486a-4da0-a5e8-f50d743cc945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:00.547735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cbd08-486a-4da0-a5e8-f50d743cc945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:00.548609 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cbd08-486a-4da0-a5e8-f50d743cc945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:00.550234 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cbd08-486a-4da0-a5e8-f50d743cc945 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:00.565750 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1430/2855] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:21:00 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:00.570429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad3ee-de91-4bb1-abcd-a10f1ffe6b2e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:00.580471 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ad3ee-de91-4bb1-abcd-a10f1ffe6b2e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:00.585839 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f960bbc-361e-4376-a737-5d73107ad78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:00.586509 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f960bbc-361e-4376-a737-5d73107ad78b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:00.586797 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f960bbc-361e-4376-a737-5d73107ad78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:00.587073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f960bbc-361e-4376-a737-5d73107ad78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:00.587801 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f960bbc-361e-4376-a737-5d73107ad78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:00.589548 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f960bbc-361e-4376-a737-5d73107ad78b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:00.601980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1426/2856] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:21:00 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:00.606301 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cbd08-486a-4da0-a5e8-f50d743cc945 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:00.616618 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cbd08-486a-4da0-a5e8-f50d743cc945 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:00.621248 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:00.622125 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:00.622405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:00.622678 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] PATH_INFO: `/v3/projects/25cb32c318e04bddaa2a27526f20f8aa/users/3f7f88c04aed4e5f88c7f60fe1c232da/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:00.637769 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25cb32c318e04bddaa2a27526f20f8aa, user_id=3f7f88c04aed4e5f88c7f60fe1c232da, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:00.640478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:00.876472 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1431/2857] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:21:00 2022] PUT /identity/v3/projects/25cb32c318e04bddaa2a27526f20f8aa/users/3f7f88c04aed4e5f88c7f60fe1c232da/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:00.882097 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6d4e-650c-4497-85e3-ceeffc4f1d66 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:00.882377 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6d4e-650c-4497-85e3-ceeffc4f1d66 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:00.882706 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6d4e-650c-4497-85e3-ceeffc4f1d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:00.900213 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0e5f6d4e-650c-4497-85e3-ceeffc4f1d66 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:00.901445 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0e5f6d4e-650c-4497-85e3-ceeffc4f1d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:00.961207 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1427/2858] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:00.970735 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:00.972518 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:01.031638 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf37ac-b0fe-4661-ae43-51ba6e553b50 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:01.035226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d2f9e-3721-4e23-b075-b6a8322c7530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:01.035864 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d2f9e-3721-4e23-b075-b6a8322c7530 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:01.036142 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d2f9e-3721-4e23-b075-b6a8322c7530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:01.036440 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d2f9e-3721-4e23-b075-b6a8322c7530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:01.046396 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d2f9e-3721-4e23-b075-b6a8322c7530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:01.047819 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d2f9e-3721-4e23-b075-b6a8322c7530 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:01.057927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1432/2859] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:07.420105 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1c2f-00bb-4b20-9cb0-9a45117cadb7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:07.421132 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1c2f-00bb-4b20-9cb0-9a45117cadb7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:07.421412 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c1c2f-00bb-4b20-9cb0-9a45117cadb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:07.450283 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-570c1c2f-00bb-4b20-9cb0-9a45117cadb7 None None] MFA Rules not processed for user `3f7f88c04aed4e5f88c7f60fe1c232da`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:07.451568 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-570c1c2f-00bb-4b20-9cb0-9a45117cadb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:07.540484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1428/2860] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:21:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:07.549905 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d2f9e-3721-4e23-b075-b6a8322c7530 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:07.559043 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d2f9e-3721-4e23-b075-b6a8322c7530 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:07.566360 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd5aef-0e37-48f6-919a-6e1b7251a8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:07.567036 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd5aef-0e37-48f6-919a-6e1b7251a8de admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:07.567318 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd5aef-0e37-48f6-919a-6e1b7251a8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:07.567594 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd5aef-0e37-48f6-919a-6e1b7251a8de admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:07.569354 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd5aef-0e37-48f6-919a-6e1b7251a8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:07.571333 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd5aef-0e37-48f6-919a-6e1b7251a8de admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:07.727417 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1433/2861] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:21:07 2022] POST /identity/v3/projects => generated 372 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:21:07.731220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c1c2f-00bb-4b20-9cb0-9a45117cadb7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:07.745178 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c1c2f-00bb-4b20-9cb0-9a45117cadb7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:07.811025 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c45f5-b2c1-4268-9225-1fbb65d63624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:07.811685 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c45f5-b2c1-4268-9225-1fbb65d63624 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:07.811970 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c45f5-b2c1-4268-9225-1fbb65d63624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:07.812244 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c45f5-b2c1-4268-9225-1fbb65d63624 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:07.813004 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c45f5-b2c1-4268-9225-1fbb65d63624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:07.814941 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c45f5-b2c1-4268-9225-1fbb65d63624 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:07.933693 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1429/2862] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:21:07 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:21:07.937656 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd5aef-0e37-48f6-919a-6e1b7251a8de admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:07.949528 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd5aef-0e37-48f6-919a-6e1b7251a8de admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:07.954916 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae399f-5bea-4cad-992d-8278e1c6ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:07.956581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae399f-5bea-4cad-992d-8278e1c6ef25 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:07.956581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae399f-5bea-4cad-992d-8278e1c6ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:07.956581 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae399f-5bea-4cad-992d-8278e1c6ef25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:07.957124 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae399f-5bea-4cad-992d-8278e1c6ef25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:07.959226 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae399f-5bea-4cad-992d-8278e1c6ef25 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:07.971546 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1434/2863] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:21:07 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:21:07.977038 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c45f5-b2c1-4268-9225-1fbb65d63624 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:07.987624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c45f5-b2c1-4268-9225-1fbb65d63624 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:07.993345 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b52e1-32ef-4d19-b712-d3def9370b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:07.994331 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b52e1-32ef-4d19-b712-d3def9370b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:07.994678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b52e1-32ef-4d19-b712-d3def9370b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:07.995023 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b52e1-32ef-4d19-b712-d3def9370b14 admin admin] PATH_INFO: `/v3/projects/d551169f9f0942269d5f9ed0547eb286/users/ef980947cc88485a9825d9d15b23752b/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:07.999505 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:08.011661 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b52e1-32ef-4d19-b712-d3def9370b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d551169f9f0942269d5f9ed0547eb286, user_id=ef980947cc88485a9825d9d15b23752b, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:08.014368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b52e1-32ef-4d19-b712-d3def9370b14 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:08.088177 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1430/2864] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:21:07 2022] PUT /identity/v3/projects/d551169f9f0942269d5f9ed0547eb286/users/ef980947cc88485a9825d9d15b23752b/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:08.092031 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae399f-5bea-4cad-992d-8278e1c6ef25 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:08.104097 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae399f-5bea-4cad-992d-8278e1c6ef25 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:08.136981 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:08.163989 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8adfb-4c45-4ec4-bef2-72a5c4965ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:08.166438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8adfb-4c45-4ec4-bef2-72a5c4965ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:08.166438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8adfb-4c45-4ec4-bef2-72a5c4965ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:08.166438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8adfb-4c45-4ec4-bef2-72a5c4965ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:08.166438 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8adfb-4c45-4ec4-bef2-72a5c4965ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:08.167930 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8adfb-4c45-4ec4-bef2-72a5c4965ee7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:08.178327 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1435/2865] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:21:08 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:08.182573 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b52e1-32ef-4d19-b712-d3def9370b14 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:08.194407 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b52e1-32ef-4d19-b712-d3def9370b14 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:08.199293 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde0d1-63a7-4e77-a9ff-f7ae7f3203b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:08.200179 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde0d1-63a7-4e77-a9ff-f7ae7f3203b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:08.200516 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde0d1-63a7-4e77-a9ff-f7ae7f3203b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:08.200810 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde0d1-63a7-4e77-a9ff-f7ae7f3203b9 admin admin] PATH_INFO: `/v3/projects/d551169f9f0942269d5f9ed0547eb286/users/ef980947cc88485a9825d9d15b23752b/roles/6e7cd2f56dab404082420e2f568d3460` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:08.202806 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecde0d1-63a7-4e77-a9ff-f7ae7f3203b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d551169f9f0942269d5f9ed0547eb286, user_id=ef980947cc88485a9825d9d15b23752b, role_id=6e7cd2f56dab404082420e2f568d3460)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:08.205564 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecde0d1-63a7-4e77-a9ff-f7ae7f3203b9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:08.217836 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1431/2866] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:21:08 2022] PUT /identity/v3/projects/d551169f9f0942269d5f9ed0547eb286/users/ef980947cc88485a9825d9d15b23752b/roles/6e7cd2f56dab404082420e2f568d3460 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:13.612810 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb40ae-b09a-4c52-8e51-6fa301899ab3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:13.613670 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb40ae-b09a-4c52-8e51-6fa301899ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:13.614091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb40ae-b09a-4c52-8e51-6fa301899ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:13.641044 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2fbb40ae-b09a-4c52-8e51-6fa301899ab3 None None] MFA Rules not processed for user `e53c9435ac5d4a6d89e636bffe1147e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:13.642835 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2fbb40ae-b09a-4c52-8e51-6fa301899ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:13.716285 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1436/2867] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:21:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:14.749772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b01346-3938-4068-a0a4-0651b52f8bf0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:14.749772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b01346-3938-4068-a0a4-0651b52f8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:14.749772 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b01346-3938-4068-a0a4-0651b52f8bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:14.814054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-75b01346-3938-4068-a0a4-0651b52f8bf0 None None] MFA Rules not processed for user `ef980947cc88485a9825d9d15b23752b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:14.815368 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-75b01346-3938-4068-a0a4-0651b52f8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:14.906498 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1432/2868] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:21:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:14.920703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb40ae-b09a-4c52-8e51-6fa301899ab3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:14.922437 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2fbb40ae-b09a-4c52-8e51-6fa301899ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:15.010028 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb40ae-b09a-4c52-8e51-6fa301899ab3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:15.018614 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f53ec7-2c84-4010-b1b3-12122f992e85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:15.019587 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53ec7-2c84-4010-b1b3-12122f992e85 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:15.020021 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53ec7-2c84-4010-b1b3-12122f992e85 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:15.020508 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53ec7-2c84-4010-b1b3-12122f992e85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:15.082986 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f53ec7-2c84-4010-b1b3-12122f992e85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:15.086629 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f53ec7-2c84-4010-b1b3-12122f992e85 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:15.097507 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1437/2869] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:21:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:18.907363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f599a-e3ec-4acb-a34c-ecfd60271743 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:18.907933 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f599a-e3ec-4acb-a34c-ecfd60271743 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:18.908363 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f599a-e3ec-4acb-a34c-ecfd60271743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:18.930050 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-048f599a-e3ec-4acb-a34c-ecfd60271743 None None] MFA Rules not processed for user `3f7f88c04aed4e5f88c7f60fe1c232da`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:18.931336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-048f599a-e3ec-4acb-a34c-ecfd60271743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:18.939762 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1433/2870] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:21:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:25.093068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:28.924055 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=48,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:29.596104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3878-4eec-496a-b3c5-8681d3739478 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:29.596616 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3878-4eec-496a-b3c5-8681d3739478 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:29.598617 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3878-4eec-496a-b3c5-8681d3739478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:29.620627 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-94dc3878-4eec-496a-b3c5-8681d3739478 None None] MFA Rules not processed for user `c786580d6b5d4e50afbb2ee7a32acadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:29.622061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-94dc3878-4eec-496a-b3c5-8681d3739478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:29.688803 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1438/2871] 10.222.0.123 () {58 vars in 972 bytes} [Thu May 26 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:29.708747 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f599a-e3ec-4acb-a34c-ecfd60271743 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:29.710295 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-048f599a-e3ec-4acb-a34c-ecfd60271743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:29.788746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f599a-e3ec-4acb-a34c-ecfd60271743 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:29.794385 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbee9630954680bcec917996319e3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:29.795127 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:29.795510 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:29.795790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:29.805989 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:29.807692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:29.816010 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1434/2872] 10.222.0.123 () {60 vars in 1389 bytes} [Thu May 26 18:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:21:34.303302 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca5a1-fc6a-4ddf-baff-578cd5186085 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:34.303831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca5a1-fc6a-4ddf-baff-578cd5186085 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:34.303831 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca5a1-fc6a-4ddf-baff-578cd5186085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:34.323189 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-051ca5a1-fc6a-4ddf-baff-578cd5186085 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:34.326168 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-051ca5a1-fc6a-4ddf-baff-578cd5186085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:34.410293 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1439/2873] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:34.424420 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:34.427446 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:34.447788 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681892b0-2de5-4118-8166-9a87c2194987 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:34.455114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f865689-b668-4ee7-98b6-2bab5ab66fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:34.456440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f865689-b668-4ee7-98b6-2bab5ab66fac service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:34.456936 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f865689-b668-4ee7-98b6-2bab5ab66fac service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:34.457225 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f865689-b668-4ee7-98b6-2bab5ab66fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:34.467504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f865689-b668-4ee7-98b6-2bab5ab66fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:34.469409 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f865689-b668-4ee7-98b6-2bab5ab66fac service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:34.483890 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1435/2874] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:38.159980 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad47d5-a489-426b-8049-beaf2bd6f0e6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.160765 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad47d5-a489-426b-8049-beaf2bd6f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.162809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad47d5-a489-426b-8049-beaf2bd6f0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.181445 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2aad47d5-a489-426b-8049-beaf2bd6f0e6 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:38.182732 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2aad47d5-a489-426b-8049-beaf2bd6f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:38.191108 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1440/2875] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:38.205083 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f865689-b668-4ee7-98b6-2bab5ab66fac service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.221438 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f865689-b668-4ee7-98b6-2bab5ab66fac service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.227850 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b7ea3-b592-40e5-b282-29567e962e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.231604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7ea3-b592-40e5-b282-29567e962e37 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.231604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7ea3-b592-40e5-b282-29567e962e37 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.231604 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b7ea3-b592-40e5-b282-29567e962e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.240490 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b7ea3-b592-40e5-b282-29567e962e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.242142 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b7ea3-b592-40e5-b282-29567e962e37 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.252956 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1436/2876] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:39.326365 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad47d5-a489-426b-8049-beaf2bd6f0e6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:39.327927 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2aad47d5-a489-426b-8049-beaf2bd6f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:39.341212 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad47d5-a489-426b-8049-beaf2bd6f0e6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:39.346543 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:39.347464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.347745 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.348015 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] PATH_INFO: `/v3/users/7f86adaf1fff4b94b2911633b61adefe` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.349250 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f86adaf1fff4b94b2911633b61adefe)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:39.351169 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:39.642849 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f86adaf1fff4b94b2911633b61adefe'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:39.643523 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f86adaf1fff4b94b2911633b61adefe'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:39.644133 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f86adaf1fff4b94b2911633b61adefe'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:39.656257 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f86adaf1fff4b94b2911633b61adefe'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:39.664349 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f86adaf1fff4b94b2911633b61adefe'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:39.841606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1441/2877] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:21:39 2022] DELETE /identity/v3/users/7f86adaf1fff4b94b2911633b61adefe => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:40.214601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b7ea3-b592-40e5-b282-29567e962e37 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:40.215285 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b7ea3-b592-40e5-b282-29567e962e37 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:40.279424 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:40.280637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:40.281090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:40.281373 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] PATH_INFO: `/v3/projects/9066457724434c9593660f92733003b5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:40.282612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9066457724434c9593660f92733003b5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:40.285718 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:40.428204 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9066457724434c9593660f92733003b5', 'request_id': 'req-4dcccefc-5555-4c93-924a-64db992cb02e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.547907 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9066457724434c9593660f92733003b5', 'request_id': 'req-4dcccefc-5555-4c93-924a-64db992cb02e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.555670 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9066457724434c9593660f92733003b5', 'request_id': 'req-4dcccefc-5555-4c93-924a-64db992cb02e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.559982 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:40.569287 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] The token cache is being invalidate because project 9066457724434c9593660f92733003b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:21:40.570070 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.570951 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dcccefc-5555-4c93-924a-64db992cb02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.573211 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1437/2878] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:21:40 2022] DELETE /identity/v3/projects/9066457724434c9593660f92733003b5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:40.577329 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:40.578920 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:40.594395 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793aebe-28e0-4e44-9778-9b409a3f0cea admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:40.603361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:40.665052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:40.666076 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:40.666560 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:40.666947 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] PATH_INFO: `/v3/users/2c1ab8e813de4d19ba05cd752d95b8cc` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:40.668708 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1ab8e813de4d19ba05cd752d95b8cc)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:40.670872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:40.871612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d51913-3745-415a-b353-b0757f5083aa None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:40.871983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d51913-3745-415a-b353-b0757f5083aa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:40.872677 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d51913-3745-415a-b353-b0757f5083aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:40.894629 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e3d51913-3745-415a-b353-b0757f5083aa None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:40.895938 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e3d51913-3745-415a-b353-b0757f5083aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:40.905181 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1438/2879] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:40.925530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d51913-3745-415a-b353-b0757f5083aa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:40.927418 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e3d51913-3745-415a-b353-b0757f5083aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:40.927806 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1ab8e813de4d19ba05cd752d95b8cc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.928597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1ab8e813de4d19ba05cd752d95b8cc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.929412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1ab8e813de4d19ba05cd752d95b8cc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.967200 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1ab8e813de4d19ba05cd752d95b8cc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:40.982027 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b9ebab6e-dda8-491c-b16d-b96843b08fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1ab8e813de4d19ba05cd752d95b8cc'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:41.031561 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d51913-3745-415a-b353-b0757f5083aa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:41.037940 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:41.038599 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.038983 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.039276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.041073 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:41.053906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:41.055790 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:41.069315 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1439/2880] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:21:41.107304 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1442/2881] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:21:40 2022] DELETE /identity/v3/users/2c1ab8e813de4d19ba05cd752d95b8cc => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:41.464223 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:41.465809 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:41.480953 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f7f6-a48d-4652-a16f-2f30ddd13892 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:41.542855 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:41.543743 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.544014 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.544284 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] PATH_INFO: `/v3/projects/43a19b1c729c48068defa7079af9cd37` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.545506 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a19b1c729c48068defa7079af9cd37)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:41.547637 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:41.737646 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a19b1c729c48068defa7079af9cd37', 'request_id': 'req-a649bc72-b8fa-45bd-ba8f-137519c98345'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:41.816721 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a19b1c729c48068defa7079af9cd37', 'request_id': 'req-a649bc72-b8fa-45bd-ba8f-137519c98345'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:41.824658 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a19b1c729c48068defa7079af9cd37', 'request_id': 'req-a649bc72-b8fa-45bd-ba8f-137519c98345'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:41.837336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] The token cache is being invalidate because project 43a19b1c729c48068defa7079af9cd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:21:41.837659 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:41.838316 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:41.860724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1440/2882] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:21:41 2022] DELETE /identity/v3/projects/43a19b1c729c48068defa7079af9cd37 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:44.102460 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803f0b-6b8d-4fdc-a19c-a4b6349ff337 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:44.102943 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803f0b-6b8d-4fdc-a19c-a4b6349ff337 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:44.103146 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803f0b-6b8d-4fdc-a19c-a4b6349ff337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:44.122478 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f4803f0b-6b8d-4fdc-a19c-a4b6349ff337 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:44.123680 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f4803f0b-6b8d-4fdc-a19c-a4b6349ff337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:44.183669 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1443/2883] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:44.198212 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:44.199636 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:44.205613 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:44.274343 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649bc72-b8fa-45bd-ba8f-137519c98345 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:44.280375 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff051a-6c51-41e6-bdfc-892f1a78674c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:44.281022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff051a-6c51-41e6-bdfc-892f1a78674c service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:44.281304 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff051a-6c51-41e6-bdfc-892f1a78674c service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:44.281775 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff051a-6c51-41e6-bdfc-892f1a78674c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:44.290484 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff051a-6c51-41e6-bdfc-892f1a78674c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:44.292253 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff051a-6c51-41e6-bdfc-892f1a78674c service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:44.303457 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1441/2884] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:47.341109 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f5f11-fca9-4126-ac5c-09a62e392746 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:47.341625 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f5f11-fca9-4126-ac5c-09a62e392746 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:47.341727 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f5f11-fca9-4126-ac5c-09a62e392746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:47.360000 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-055f5f11-fca9-4126-ac5c-09a62e392746 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:47.361107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-055f5f11-fca9-4126-ac5c-09a62e392746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:47.370093 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1444/2885] 10.222.0.59 () {58 vars in 1020 bytes} [Thu May 26 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:47.386921 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff051a-6c51-41e6-bdfc-892f1a78674c service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:47.398326 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff051a-6c51-41e6-bdfc-892f1a78674c service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:47.403897 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:47.409483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:47.409483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:47.409483 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:47.414117 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:47.415700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:47.426433 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1442/2886] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:52.218988 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f5f11-fca9-4126-ac5c-09a62e392746 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:52.220553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-055f5f11-fca9-4126-ac5c-09a62e392746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:52.251223 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:52.281482 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f5f11-fca9-4126-ac5c-09a62e392746 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:52.286084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:52.286738 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:52.287018 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:52.287290 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:52.289082 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:52.357235 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:52.357235 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:52.367952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1445/2887] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:57.421161 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=39 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:02.633289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=39 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:21.600530 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:21.602052 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:21.617147 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aee1d-9f4b-4cf8-b846-00daca98f47b service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:21.621728 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:21.623165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.623165 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.623402 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] PATH_INFO: `/v3/users/e53c9435ac5d4a6d89e636bffe1147e8` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.624463 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53c9435ac5d4a6d89e636bffe1147e8)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:21.626381 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.913851 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53c9435ac5d4a6d89e636bffe1147e8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.914514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53c9435ac5d4a6d89e636bffe1147e8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.915114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53c9435ac5d4a6d89e636bffe1147e8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.928280 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53c9435ac5d4a6d89e636bffe1147e8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.935620 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a5b5e6cc-7c26-4d2e-8d29-b0d3c3977fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53c9435ac5d4a6d89e636bffe1147e8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.063865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1443/2888] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:22:21 2022] DELETE /identity/v3/users/e53c9435ac5d4a6d89e636bffe1147e8 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:22.361239 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.372047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aeaed-d443-402d-bc0e-c6f7aaa07800 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.431899 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.432833 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.433052 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.433317 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] PATH_INFO: `/v3/projects/d84c437938314ec78375a4201a5bfca4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.434544 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84c437938314ec78375a4201a5bfca4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.437388 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.617524 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84c437938314ec78375a4201a5bfca4', 'request_id': 'req-022d2f75-6673-45e3-a37e-edcb219b2637'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.772269 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84c437938314ec78375a4201a5bfca4', 'request_id': 'req-022d2f75-6673-45e3-a37e-edcb219b2637'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.779283 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84c437938314ec78375a4201a5bfca4', 'request_id': 'req-022d2f75-6673-45e3-a37e-edcb219b2637'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.789945 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] The token cache is being invalidate because project d84c437938314ec78375a4201a5bfca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:22.793155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.793155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-022d2f75-6673-45e3-a37e-edcb219b2637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.793155 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1446/2889] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:22:22 2022] DELETE /identity/v3/projects/d84c437938314ec78375a4201a5bfca4 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:22.797857 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2d90-7707-4b6b-bcb2-8eec82d9f3bc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.798353 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2d90-7707-4b6b-bcb2-8eec82d9f3bc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.798455 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2d90-7707-4b6b-bcb2-8eec82d9f3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.816508 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5eaa2d90-7707-4b6b-bcb2-8eec82d9f3bc None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:22.817692 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5eaa2d90-7707-4b6b-bcb2-8eec82d9f3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.876570 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1444/2890] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:22.884458 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b77c5-5089-4a41-8655-abe8818f811e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.886872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b77c5-5089-4a41-8655-abe8818f811e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.886872 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b77c5-5089-4a41-8655-abe8818f811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.904173 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cd9b77c5-5089-4a41-8655-abe8818f811e None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:22.905679 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cd9b77c5-5089-4a41-8655-abe8818f811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.913580 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1447/2891] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:22.917894 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2d90-7707-4b6b-bcb2-8eec82d9f3bc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.928975 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2d90-7707-4b6b-bcb2-8eec82d9f3bc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.933912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.934590 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.935512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.935785 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.936717 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:22.937033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.938708 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.952159 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1445/2892] 10.222.0.123 () {58 vars in 1157 bytes} [Thu May 26 18:22:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:22.956858 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b77c5-5089-4a41-8655-abe8818f811e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.967089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b77c5-5089-4a41-8655-abe8818f811e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.972088 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728df7f2-edfd-43a4-afa3-02a62af57fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.972801 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728df7f2-edfd-43a4-afa3-02a62af57fec admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.973084 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728df7f2-edfd-43a4-afa3-02a62af57fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.973361 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728df7f2-edfd-43a4-afa3-02a62af57fec admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.974074 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728df7f2-edfd-43a4-afa3-02a62af57fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.976104 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728df7f2-edfd-43a4-afa3-02a62af57fec admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.094182 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1448/2893] 10.222.0.123 () {60 vars in 1157 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/projects => generated 400 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:23.098965 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.110831 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04202600-bd83-490a-8937-5109ffbb6e64 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.167440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5385-3531-4c01-ae89-a5a9924ab814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.168092 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5385-3531-4c01-ae89-a5a9924ab814 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.168403 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5385-3531-4c01-ae89-a5a9924ab814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.168678 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5385-3531-4c01-ae89-a5a9924ab814 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.169934 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5385-3531-4c01-ae89-a5a9924ab814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.172077 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5385-3531-4c01-ae89-a5a9924ab814 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.178920 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:23.282100 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1446/2894] 10.222.0.123 () {60 vars in 1148 bytes} [Thu May 26 18:22:23 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:23.286418 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728df7f2-edfd-43a4-afa3-02a62af57fec admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.297897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728df7f2-edfd-43a4-afa3-02a62af57fec admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.302878 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48678cb-64c6-4485-afbf-0b91f7efefee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.303541 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48678cb-64c6-4485-afbf-0b91f7efefee admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.303825 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48678cb-64c6-4485-afbf-0b91f7efefee admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.304100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48678cb-64c6-4485-afbf-0b91f7efefee admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.304863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48678cb-64c6-4485-afbf-0b91f7efefee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.306490 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48678cb-64c6-4485-afbf-0b91f7efefee admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.317471 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1449/2895] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:22:23 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:23.321601 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5385-3531-4c01-ae89-a5a9924ab814 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.332422 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5385-3531-4c01-ae89-a5a9924ab814 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.337146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56298335-9aba-438c-a109-38d0abc17dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.338980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56298335-9aba-438c-a109-38d0abc17dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.338980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56298335-9aba-438c-a109-38d0abc17dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.338980 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56298335-9aba-438c-a109-38d0abc17dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.339336 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56298335-9aba-438c-a109-38d0abc17dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.340663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56298335-9aba-438c-a109-38d0abc17dd3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.352029 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1447/2896] 10.222.0.123 () {58 vars in 1126 bytes} [Thu May 26 18:22:23 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:23.356375 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48678cb-64c6-4485-afbf-0b91f7efefee admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.367167 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48678cb-64c6-4485-afbf-0b91f7efefee admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.372091 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.373047 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.373313 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.373590 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] PATH_INFO: `/v3/projects/3563154390134fb1906051575310da81/users/4601072ceac646a0b84feabb727c933a/roles/4d22d1a6df3d4e74b94189c29cd1fd5c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.388451 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3563154390134fb1906051575310da81, user_id=4601072ceac646a0b84feabb727c933a, role_id=4d22d1a6df3d4e74b94189c29cd1fd5c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.391254 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.491086 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1450/2897] 10.222.0.123 () {60 vars in 1487 bytes} [Thu May 26 18:22:23 2022] PUT /identity/v3/projects/3563154390134fb1906051575310da81/users/4601072ceac646a0b84feabb727c933a/roles/4d22d1a6df3d4e74b94189c29cd1fd5c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:23.506022 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f21e-8e44-401a-a4fa-196158b0e5cd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.506311 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f21e-8e44-401a-a4fa-196158b0e5cd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.506588 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f21e-8e44-401a-a4fa-196158b0e5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.533724 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ae03f21e-8e44-401a-a4fa-196158b0e5cd None None] MFA Rules not processed for user `4601072ceac646a0b84feabb727c933a`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:23.534908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ae03f21e-8e44-401a-a4fa-196158b0e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.597985 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1448/2898] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:23.609319 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.611107 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.642510 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:23.669777 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469729f-ce60-4644-bb09-bce41c1aa06f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.673521 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cb7ea-2e2a-40cf-914a-a5f97b5de7c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425574d1c0a04fb29452e7f7d0b7d685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.674159 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cb7ea-2e2a-40cf-914a-a5f97b5de7c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.674439 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cb7ea-2e2a-40cf-914a-a5f97b5de7c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.674713 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cb7ea-2e2a-40cf-914a-a5f97b5de7c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.683127 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cb7ea-2e2a-40cf-914a-a5f97b5de7c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.684700 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cb7ea-2e2a-40cf-914a-a5f97b5de7c6 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.694123 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1451/2899] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:22:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:30.279906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03f21e-8e44-401a-a4fa-196158b0e5cd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:30.343899 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03f21e-8e44-401a-a4fa-196158b0e5cd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:30.356514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:30.356514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:30.356514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:30.356514 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] PATH_INFO: `/v3/users/4601072ceac646a0b84feabb727c933a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:30.357049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4601072ceac646a0b84feabb727c933a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:30.357049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:30.647005 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4601072ceac646a0b84feabb727c933a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.647914 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4601072ceac646a0b84feabb727c933a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.648531 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4601072ceac646a0b84feabb727c933a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.660500 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4601072ceac646a0b84feabb727c933a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.664906 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:30.667704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4601072ceac646a0b84feabb727c933a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.804623 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1449/2900] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:22:30 2022] DELETE /identity/v3/users/4601072ceac646a0b84feabb727c933a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:30.809095 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d709-063b-4582-9ed0-df3df173d815 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:30.809551 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d709-063b-4582-9ed0-df3df173d815 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:30.809664 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d709-063b-4582-9ed0-df3df173d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:30.827470 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-04a3d709-063b-4582-9ed0-df3df173d815 None None] MFA Rules not processed for user `a9572da5208c472b8724a85b89731b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:30.828703 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-04a3d709-063b-4582-9ed0-df3df173d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:30.887562 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1452/2901] 10.222.0.123 () {58 vars in 962 bytes} [Thu May 26 18:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:30.897779 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:30.899141 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:30.958871 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2df9c6-e53a-4980-abe0-2aeaabaf988a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:30.962440 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:30.963150 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:30.963430 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:30.963701 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:30.973468 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:30.974912 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:30.984546 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1450/2902] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:31.511054 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3d709-063b-4582-9ed0-df3df173d815 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:31.516743 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-04a3d709-063b-4582-9ed0-df3df173d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:31.525072 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3d709-063b-4582-9ed0-df3df173d815 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:31.530292 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:31.531164 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:31.531446 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:31.531723 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] PATH_INFO: `/v3/projects/3563154390134fb1906051575310da81` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:31.533428 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3563154390134fb1906051575310da81)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:31.535392 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:31.684958 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3563154390134fb1906051575310da81', 'request_id': 'req-fb90205e-cd1c-4e63-833c-9b32dc989b7d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.816863 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3563154390134fb1906051575310da81', 'request_id': 'req-fb90205e-cd1c-4e63-833c-9b32dc989b7d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.823622 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3563154390134fb1906051575310da81', 'request_id': 'req-fb90205e-cd1c-4e63-833c-9b32dc989b7d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.841242 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] The token cache is being invalidate because project 3563154390134fb1906051575310da81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:31.841538 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.842193 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.843737 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1453/2903] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:22:31 2022] DELETE /identity/v3/projects/3563154390134fb1906051575310da81 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:40.980323 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=30,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:41.837316 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:26.392275 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:26.393707 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:26.405892 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc004-bf2e-4794-a746-87625b8426ce service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:26.456849 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:26.457488 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:26.457771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:26.458049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:26.459846 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:26.469628 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:26.471064 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:26.479539 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1451/2904] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:23:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:36.475447 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=26 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:49.474923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:49.476553 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:49.518201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90205e-cd1c-4e63-833c-9b32dc989b7d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:49.522100 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:49.528154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:49.528154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:49.528154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:49.528154 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:49.621443 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:49.622882 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:49.634385 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1454/2905] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:23:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:50.808429 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:50.809853 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:50.849771 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabd1f-27ef-4657-bb01-5bbe916c1c4c service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:50.853435 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:50.854058 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:50.854338 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:50.854612 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:50.856321 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:50.870512 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:50.871935 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:50.883919 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1452/2906] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:23:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:59.629559 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=56 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:00.879099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=19 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:03.200506 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:03.219584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da936fed-f4a1-4a7d-853f-abcea56ea0a9 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:03.223348 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:03.224137 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:03.224277 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:03.224584 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:03.226412 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:03.251206 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:03.252893 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:03.261101 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1455/2907] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:24:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:04.347482 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.366786 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2c083-5ceb-4796-85bf-ad34c042aa9b service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.370480 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66452133fd6348109e3065303947ecce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.371114 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.371390 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.371663 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.373470 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:04.387734 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.389908 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.401586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1453/2908] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:24:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:04.470890 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.472484 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:04.541730 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477f24-bfc9-4e53-aaba-2860fa883658 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.547068 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.547717 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.548003 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.548282 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.550080 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:04.562247 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.563880 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.574060 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1456/2909] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:24:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:06.469146 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:06.470577 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:06.485047 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41e65c-517b-4dd9-8127-ed424c1147a5 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:06.490426 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:06.491054 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:06.491333 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:06.491607 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:06.493481 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:06.506704 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:06.508286 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:06.519396 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1454/2910] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:24:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:14.569725 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=47 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:16.514395 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=16 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:31.709935 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:31.711946 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:31.777144 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08b18f-801d-4419-b7e0-5d0b4d8a4ae7 service placement] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:31.783601 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:31.786405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:31.786405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:31.786405 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:31.788747 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:31.803826 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:31.805476 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:31.818115 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1457/2911] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:25:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:34.171700 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:34.200624 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26373f7b-0a85-4b37-926e-8182c0802887 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:34.206109 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fd75bf129c642a89153efcb584406d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:34.206746 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:34.207072 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:34.207543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:34.209522 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:34.222340 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:34.229769 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:34.235832 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1455/2912] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:25:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:35.143357 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:35.165754 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357c81-b3ee-4f45-b34f-5a3dd7813d62 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:35.171011 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:35.171651 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:35.171963 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:35.172243 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:35.174089 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:35.201809 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:35.203402 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:35.214289 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1458/2913] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:25:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:40.904033 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:40.906090 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:40.928235 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a311d2-58c2-47f1-8fa7-35138be18e9f service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:40.933495 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe692e2ebff459f89835258db961125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a99cda0f0ded4bf184bfd61871340453', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:40.934263 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:40.934547 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:40.934826 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:40.936744 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:40.950360 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:40.952049 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:40.964206 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1456/2914] 10.222.0.123 () {60 vars in 1370 bytes} [Thu May 26 18:25:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:44.738923 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:44.740857 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:44.837078 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dbb05-9b00-469c-8760-687838172c1a service placement] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:44.841606 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:44.842464 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:44.842742 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:44.843009 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] PATH_INFO: `/v3/users/3f7f88c04aed4e5f88c7f60fe1c232da` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:44.844171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7f88c04aed4e5f88c7f60fe1c232da)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:44.846132 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:45.096400 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7f88c04aed4e5f88c7f60fe1c232da'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.097620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7f88c04aed4e5f88c7f60fe1c232da'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.098215 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7f88c04aed4e5f88c7f60fe1c232da'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.108620 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:45.110597 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7f88c04aed4e5f88c7f60fe1c232da'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.117897 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7f88c04aed4e5f88c7f60fe1c232da'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.218836 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1459/2915] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:25:44 2022] DELETE /identity/v3/users/3f7f88c04aed4e5f88c7f60fe1c232da => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:45.525130 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:45.544276 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed2b76-8978-4779-86f8-c0837903a689 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:45.610492 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:45.611259 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:45.611543 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:45.611865 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] PATH_INFO: `/v3/projects/25cb32c318e04bddaa2a27526f20f8aa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:45.613567 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=25cb32c318e04bddaa2a27526f20f8aa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:45.615504 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:45.733299 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25cb32c318e04bddaa2a27526f20f8aa', 'request_id': 'req-a0f91d98-a99d-4e93-9093-ed9f1365c0af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.807016 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25cb32c318e04bddaa2a27526f20f8aa', 'request_id': 'req-a0f91d98-a99d-4e93-9093-ed9f1365c0af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.814189 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25cb32c318e04bddaa2a27526f20f8aa', 'request_id': 'req-a0f91d98-a99d-4e93-9093-ed9f1365c0af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.825220 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] The token cache is being invalidate because project 25cb32c318e04bddaa2a27526f20f8aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:25:45.825503 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.826116 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:45.827651 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1457/2916] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:25:45 2022] DELETE /identity/v3/projects/25cb32c318e04bddaa2a27526f20f8aa => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:45.831693 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:45.836871 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:45.845900 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa320f-8f67-4486-aa3e-dedab54002ab admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:45.902201 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:45.903070 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:45.903351 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:45.903626 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] PATH_INFO: `/v3/users/ef980947cc88485a9825d9d15b23752b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:45.904829 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef980947cc88485a9825d9d15b23752b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:45.906757 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:46.107346 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef980947cc88485a9825d9d15b23752b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.107952 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef980947cc88485a9825d9d15b23752b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.108573 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef980947cc88485a9825d9d15b23752b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.121407 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef980947cc88485a9825d9d15b23752b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.129171 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1cede64a-710f-4a85-b0bc-43f119afa882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef980947cc88485a9825d9d15b23752b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.212061 dv-cinder-839064-2-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1460/2917] 10.222.0.123 () {58 vars in 1228 bytes} [Thu May 26 18:25:45 2022] DELETE /identity/v3/users/ef980947cc88485a9825d9d15b23752b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:46.483730 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:46.489842 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:46.499288 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f91d98-a99d-4e93-9093-ed9f1365c0af admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:46.550834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:46.562834 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9572da5208c472b8724a85b89731b10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5b85a0a8c034126972b9b0b0e372a47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:46.563719 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:46.564000 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:46.564272 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] PATH_INFO: `/v3/projects/d551169f9f0942269d5f9ed0547eb286` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:46.565515 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d551169f9f0942269d5f9ed0547eb286)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:46.567586 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:46.750266 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd551169f9f0942269d5f9ed0547eb286', 'request_id': 'req-bbcf48e2-dddc-476e-8723-3a05004f21d1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.881279 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd551169f9f0942269d5f9ed0547eb286', 'request_id': 'req-bbcf48e2-dddc-476e-8723-3a05004f21d1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.888544 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd551169f9f0942269d5f9ed0547eb286', 'request_id': 'req-bbcf48e2-dddc-476e-8723-3a05004f21d1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.900197 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] The token cache is being invalidate because project d551169f9f0942269d5f9ed0547eb286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:25:46.900501 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.901118 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bbcf48e2-dddc-476e-8723-3a05004f21d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.902645 dv-cinder-839064-2-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1458/2918] 10.222.0.123 () {58 vars in 1237 bytes} [Thu May 26 18:25:46 2022] DELETE /identity/v3/projects/d551169f9f0942269d5f9ed0547eb286 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:25:56.208381 dv-cinder-839064-2-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=12,keystone:SELECT=60,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:56.897099 dv-cinder-839064-2-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}